Sep 30 19:58:08 devstack cinder-volume[72220]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72220) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 19:58:08 devstack cinder-volume[72220]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72220) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 19:58:08 devstack cinder-volume[72220]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72220) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO dbcounter [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Registered counter for database cinder
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_db.sqlalchemy.engines [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG dbcounter [-] [72220] Writer thread running {{(pid=72220) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO cinder.rpc [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO cinder.rpc [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_db.sqlalchemy.engines [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO cinder.volume.manager [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Determined volume DB was empty at startup.
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG cinder.volume.manager [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72220) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO cinder.volume.manager [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 30 19:58:09 devstack cinder-volume[72220]: WARNING stevedore.named [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 19:58:09 devstack cinder-volume[72220]: WARNING castellan.key_manager [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 19:58:09 devstack cinder-volume[72220]: WARNING cinder.keymgr.conf_key_mgr [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG cinder.volume.drivers.lvm [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72220) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_concurrency.processutils [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_concurrency.processutils [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.257s {{(pid=72220) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_db.sqlalchemy.engines [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO cinder.rpc [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO cinder.rpc [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 30 19:58:09 devstack cinder-volume[72220]: WARNING stevedore.named [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 19:58:09 devstack cinder-volume[72220]: WARNING castellan.key_manager [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO cinder.volume.manager [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_db.sqlalchemy.engines [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 19:58:09 devstack cinder-volume[72220]: INFO oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Starting 1 workers
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Started child 72319 {{(pid=72220) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Full set of CONF: {{(pid=72220) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] ******************************************************************************** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Configuration options gathered from: {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] ================================================================================ {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] allow_availability_zone_fallback = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] allow_compression_on_image_upload = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] allowed_direct_url_schemes     = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] api_rate_limit                 = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] auth_strategy                  = keystone {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] az_cache_duration              = 3600 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_availability_zone      = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_host                   = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_name                   = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_stats_polling_interval = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backup_api_class               = cinder.backup.api.API {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backup_name_template           = backup-%s {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backup_use_same_host           = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backup_use_temp_snapshot       = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] chap_password                  = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] chap_username                  =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_internal_tenant_project_id = 1fe5c509b2144bb280efb8c57dbe4ce3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_internal_tenant_user_id = 66d62f2a8211448c87d76ca24bf48797 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cloned_volume_same_az          = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cluster                        = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] compression_format             = gzip {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] config_dir                     = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] config_source                  = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] control_exchange               = openstack {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] debug                          = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] default_availability_zone      = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] default_group_type             = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] default_volume_type            = lvmdriver-1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] driver_client_cert             = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] driver_client_cert_key         = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] driver_data_namespace          = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] driver_ssl_cert_path           = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] driver_ssl_cert_verify         = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72319]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] driver_use_ssl                 = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] enable_force_upload            = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] enable_new_services            = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] enable_unsupported_driver      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] enforce_multipath_for_image_xfer = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] filter_function                = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_api_insecure            = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_api_ssl_compression     = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_ca_certificates_file    = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_certfile                = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_keyfile                 = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_num_retries             = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance_request_timeout         = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] goodness_function              = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] graceful_shutdown_timeout      = 5 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] group_api_class                = cinder.group.api.API {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] host                           = devstack {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_compress_on_upload       = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_conversion_address_space_limit = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_conversion_cpu_limit     = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_conversion_disable       = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_upload_use_cinder_backend = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_upload_use_internal_tenant = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_volume_cache_enabled     = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_volume_cache_max_count   = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] init_host_max_objects_retrieval = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] iscsi_iotype                   = fileio {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] iscsi_target_flags             =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] iscsi_write_cache              = on {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] iser_helper                    = tgtadm {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] iser_ip_address                = 192.168.122.53 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] iser_port                      = 3260 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_color                      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_config_append              = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_dir                        = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_file                       = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_options                    = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_rotate_interval            = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_rotate_interval_type       = days {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] log_rotation_type              = none {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] max_age                        = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] max_logfile_count              = 30 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] max_logfile_size_mb            = 200 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] max_over_subscription_ratio    = 20.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] message_reap_interval          = 86400 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] message_ttl                    = 2592000 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] monkey_patch                   = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] monkey_patch_modules           = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] my_ip                          = 192.168.122.53 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] no_snapshot_gb_quota           = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] num_iser_scan_tries            = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] num_shell_tries                = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] num_volume_device_scan_tries   = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] nvmeof_conn_info_version       = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] nvmet_ns_id                    = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] nvmet_port_id                  = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] osapi_max_limit                = 1000 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] osapi_volume_ext_list          = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] osapi_volume_listen_port       = 8776 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] osapi_volume_use_ssl           = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] osapi_volume_workers           = 2 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] per_volume_size_limit          = -1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] periodic_fuzzy_delay           = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] periodic_interval              = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] public_endpoint                = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] publish_errors                 = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] quota_backup_gigabytes         = 1000 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] quota_backups                  = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] quota_gigabytes                = 1000 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] quota_groups                   = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] quota_snapshots                = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] quota_volumes                  = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] rate_limit_burst               = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] rate_limit_except_level        = CRITICAL {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] rate_limit_interval            = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] reinit_driver_count            = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] replication_device             = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] report_discard_supported       = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] report_interval                = 120 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] reservation_clean_interval     = 86400 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] reservation_expire             = 86400 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] reserved_image_namespaces      = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] reserved_percentage            = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] rpc_response_timeout           = 120 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] run_external_periodic_tasks    = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] scst_target_driver             = iscsi {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] scst_target_iqn_name           = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_down_time              = 720 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] shell_completion               = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] snapshot_name_template         = snapshot-%s {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] snapshot_same_host             = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] split_loggers                  = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] state_path                     = /opt/stack/data/cinder {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] storage_availability_zone      = nova {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] storage_protocol               = iSCSI {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] syslog_log_facility            = LOG_USER {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] target_helper                  = lioadm {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72319]: INFO cinder.volume.manager [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] target_ip_address              = 192.168.122.53 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] target_port                    = 3260 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] target_protocol                = iscsi {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] target_secondary_ip_addresses  = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] trace_flags                    = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] transport_url                  = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] until_refresh                  = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] use_chap_auth                  = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] use_default_quota_class        = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] use_journal                    = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] use_json                       = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] use_multipath_for_image_xfer   = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] use_stderr                     = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] use_syslog                     = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] verify_glance_signatures       = enabled {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_api_class               = cinder.volume.api.API {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_backend_name            = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_clear                   = zero {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_clear_ionice            = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_clear_size              = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_copy_bps_limit          = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_dd_blocksize            = 1M {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_name_template           = volume-%s {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_service_inithost_offload = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volume_usage_audit_period      = month {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] watch_log_file                 = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] zoning_mode                    = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.admin_password = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.admin_token = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.admin_user  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.auth_protocol = https {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.auth_section = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.auth_type   = password {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.auth_uri    = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.auth_version = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.cache       = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.certfile    = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.identity_uri = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.insecure    = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.interface   = public {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.keyfile     = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_password =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcache_username =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.region_name = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.service_type = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.backend                  = dogpile.cache.null {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.backend_argument         = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.backend_expiration_time  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.config_prefix            = cache.oslo {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.dead_timeout             = 60.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.debug_cache_backend      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.enable_retry_client      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.enable_socket_keepalive  = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.enabled                  = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.enforce_fips_mode        = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.expiration_time          = 600 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_dead_retry      = 300 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_password        = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_sasl_enabled    = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.memcache_username        = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.proxies                  = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.redis_db                 = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.redis_password           = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.redis_server             = localhost:6379 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.redis_socket_timeout     = 1.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.redis_username           = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.retry_attempts           = 2 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.retry_delay              = 0.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.socket_keepalive_count   = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.socket_keepalive_idle    = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.socket_keepalive_interval = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.tls_allowed_ciphers      = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.tls_cafile               = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.tls_certfile             = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.tls_enabled              = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cache.tls_keyfile              = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] coordination.backend_url       = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.asyncio_connection    = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.asyncio_slave_connection = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.backend               = sqlalchemy {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.connection            = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.connection_debug      = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.connection_parameters =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.connection_recycle_time = 3600 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.connection_trace      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.db_inc_retry_interval = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.db_max_retries        = 20 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.db_max_retry_interval = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.db_retry_interval     = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.max_overflow          = 50 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.max_pool_size         = 5 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.max_retries           = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.pool_timeout          = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.retry_interval        = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.slave_connection      = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.sqlite_synchronous    = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] database.use_db_reconnect      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.connection_string     = messaging:// {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.enabled               = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.es_doc_type           = notification {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.es_scroll_size        = 10000 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.es_scroll_time        = 2m {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.filter_error_trace    = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.hmac_keys             = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.sentinel_service_name = mymaster {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.socket_timeout        = 0.1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.trace_requests        = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler.trace_sqlalchemy      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler_jaeger.process_tags   = {} {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] profiler_otlp.service_name_prefix = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.enforce_new_defaults = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: WARNING oslo_config.cfg [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.enforce_scope      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.policy_default_rule = default {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] privsep_osbrick.group          = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] privsep_osbrick.helper_command = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] privsep_osbrick.user           = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_sys_admin.group         = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_sys_admin.helper_command = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] cinder_sys_admin.user          = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.auth_section      = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.auth_type         = password {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.certfile          = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.collect_timing    = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.insecure          = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.keyfile           = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.send_service_user_token = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.split_loggers     = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] service_user.timeout           = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.auth_section            = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.auth_type               = password {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.certfile                = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.collect_timing          = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.insecure                = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.keyfile                 = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.split_loggers           = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] glance.timeout                 = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.backend_availability_zone = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.chap_password = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.chap_username =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.driver_client_cert = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.driver_data_namespace = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.driver_use_ssl = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.extra_capabilities = {} {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.filter_function = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.goodness_function = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.iscsi_target_flags =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.iser_port     = 3260 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.lvm_share_target = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.lvm_type      = auto {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.replication_device = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.report_discard_supported = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.target_helper = tgtadm {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.target_port   = 3260 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.target_protocol = iscsi {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.trace_flags   = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.use_chap_auth = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_backend_name = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_clear  = zero {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_reports.file_event_handler = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_reports.log_dir           = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.backend_host       = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.chap_password      = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.chap_username      = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.driver_client_cert = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.extra_capabilities = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.filter_function    = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.goodness_function  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.iser_helper        = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.iser_port          = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.lvm_type           = auto {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.replication_device = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.report_discard_supported = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack sudo[72323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.reserved_percentage = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack sudo[72323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.scst_target_driver = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.storage_protocol   = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.target_ip_address  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.target_port        = 3260 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.trace_flags        = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_clear       = zero {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] lvmdriver-1.volumes_dir        = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_notifications.driver = [] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] key_manager.fixed_key          = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.barbican_api_version  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.barbican_endpoint     = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.barbican_endpoint_type = public {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.barbican_region_name  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.cafile                = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.certfile              = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.collect_timing        = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.insecure              = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.keyfile               = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.number_of_retries     = 60 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.retry_delay           = 1 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.send_service_user_token = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.split_loggers         = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.timeout               = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.verify_ssl            = True {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican.verify_ssl_path       = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.auth_section = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.auth_type = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.cafile   = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.certfile = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.collect_timing = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.insecure = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.keyfile  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.split_loggers = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] barbican_service_user.timeout  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.approle_role_id          = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.approle_secret_id        = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.kv_mountpoint            = secret {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.kv_path                  = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.kv_version               = 2 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.namespace                = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.root_token_id            = **** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.ssl_ca_crt_file          = None {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.timeout                  = 60.0 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.use_ssl                  = False {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 19:58:09 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] ******************************************************************************** {{(pid=72220) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 30 19:58:10 devstack sudo[72323]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:10 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.551s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:10 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:10 devstack sudo[72485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:10 devstack sudo[72485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:10 devstack sudo[72485]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:10 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.523s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:10 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 19:58:10 devstack cinder-volume[72319]: INFO cinder.brick.local_dev.lvm [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 30 19:58:10 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:10 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:10 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:11 devstack sudo[72688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 19:58:11 devstack sudo[72688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:11 devstack sudo[72688]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:11 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:11 devstack cinder-volume[72319]: DEBUG cinder.brick.local_dev.lvm [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72319) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 30 19:58:11 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:11 devstack sudo[72840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:11 devstack sudo[72840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:12 devstack sudo[72840]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:12 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.828s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:12 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:12 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:12 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:12 devstack sudo[72953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:12 devstack sudo[72953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:12 devstack sudo[72953]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:12 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.511s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:12 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:12 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:12 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:12 devstack sudo[73008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 30 19:58:12 devstack sudo[73008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:13 devstack sudo[73008]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:13 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.478s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:13 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:13 devstack sudo[73011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 19:58:13 devstack sudo[73011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:13 devstack sudo[73011]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:13 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:13 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:13 devstack sudo[73016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 19:58:13 devstack sudo[73016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:14 devstack sudo[73016]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:14 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:14 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:14 devstack sudo[73019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 19:58:14 devstack sudo[73019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:14 devstack sudo[73019]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:14 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:14 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:14 devstack sudo[73027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:14 devstack sudo[73027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:15 devstack sudo[73027]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:15 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:15 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:15 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:15 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:15 devstack sudo[73031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:15 devstack sudo[73031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:15 devstack sudo[73031]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:15 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:15 devstack cinder-volume[72319]: INFO cinder.volume.drivers.lvm [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 30 19:58:15 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:15 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:15 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:15 devstack sudo[73040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:15 devstack sudo[73040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:16 devstack sudo[73040]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:16 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.568s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:16 devstack cinder-volume[72319]: DEBUG cinder.volume.drivers.lvm [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Updating volume stats {{(pid=72319) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 30 19:58:16 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:16 devstack sudo[73157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 19:58:16 devstack sudo[73157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:16 devstack sudo[73157]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:16 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.528s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:16 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:17 devstack sudo[73220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 19:58:17 devstack sudo[73220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:17 devstack sudo[73220]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:17 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:17 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:17 devstack sudo[73304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:17 devstack sudo[73304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:17 devstack sudo[73304]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:17 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:17 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:17 devstack sudo[73309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 19:58:17 devstack sudo[73309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:18 devstack sudo[73309]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:18 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:18 devstack cinder-volume[72319]: INFO cinder.volume.driver [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 19:58:18 devstack cinder-volume[72319]: DEBUG cinder.volume.driver [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72319) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 30 19:58:18 devstack cinder-volume[72319]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 19:58:18 devstack cinder-volume[72319]: DEBUG dbcounter [-] [72319] Writer thread running {{(pid=72319) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 19:58:18 devstack cinder-volume[72319]: DEBUG cinder.db.sqlalchemy.api [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Building query based on filter {{(pid=72319) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 30 19:58:18 devstack cinder-volume[72319]: DEBUG cinder.image.image_utils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72319) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 30 19:58:18 devstack cinder-volume[72319]: INFO cinder.keymgr.migration [None req-bfe679ab-e140-4648-9fd5-65bfad3fa60d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 19:58:18 devstack cinder-volume[72319]: DEBUG cinder.volume.drivers.lvm [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Updating volume stats {{(pid=72319) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 30 19:58:18 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:18 devstack sudo[73316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 19:58:18 devstack sudo[73316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:19 devstack sudo[73316]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:19 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:19 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:19 devstack sudo[73319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 19:58:19 devstack sudo[73319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:19 devstack sudo[73319]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:19 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:19 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:19 devstack sudo[73323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:19 devstack sudo[73323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:19 devstack cinder-volume[72220]: DEBUG dbcounter [-] [72220] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72220) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 19:58:19 devstack sudo[73323]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:20 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:20 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:20 devstack sudo[73329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 19:58:20 devstack sudo[73329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:20 devstack sudo[73329]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:20 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:20 devstack cinder-volume[72319]: DEBUG cinder.manager [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Notifying Schedulers of capabilities ... {{(pid=72319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 19:58:20 devstack cinder-volume[72319]: INFO cinder.volume.manager [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Driver initialization completed successfully.
Sep 30 19:58:20 devstack cinder-volume[72319]: INFO cinder.manager [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Initiating service 2 cleanup
Sep 30 19:58:20 devstack cinder-volume[72319]: INFO cinder.manager [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Service 2 cleanup completed.
Sep 30 19:58:20 devstack cinder-volume[72319]: DEBUG cinder.service [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Creating RPC server for service cinder-volume {{(pid=72319) start /opt/stack/cinder/cinder/service.py:239}}
Sep 30 19:58:20 devstack cinder-volume[72319]: DEBUG cinder.service [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72319) start /opt/stack/cinder/cinder/service.py:245}}
Sep 30 19:58:20 devstack cinder-volume[72319]: INFO cinder.volume.manager [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 30 19:58:20 devstack cinder-volume[72319]: DEBUG cinder.volume.drivers.lvm [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Updating volume stats {{(pid=72319) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 30 19:58:20 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:20 devstack sudo[73336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 19:58:20 devstack sudo[73336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:21 devstack sudo[73336]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:21 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:21 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:21 devstack sudo[73339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 19:58:21 devstack sudo[73339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:21 devstack sudo[73339]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:21 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:21 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:21 devstack sudo[73396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 19:58:21 devstack sudo[73396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:22 devstack sudo[73396]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:22 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:22 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:58:22 devstack sudo[73399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 19:58:22 devstack sudo[73399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 19:58:22 devstack sudo[73399]: pam_unix(sudo:session): session closed for user root
Sep 30 19:58:22 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 19:58:22 devstack cinder-volume[72319]: INFO cinder.volume.manager [None req-7ec3b72d-217c-4815-be7e-0b8f6aafb625 None None] Driver post RPC initialization completed successfully.
Sep 30 19:58:32 devstack cinder-volume[72319]: DEBUG dbcounter [-] [72319] Writing DB stats cinder:SELECT=4 {{(pid=72319) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 19:58:32 devstack cinder-volume[72319]: DEBUG dbcounter [-] [72319] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72319) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 19:59:59 devstack cinder-volume[72319]: DEBUG oslo_service.periodic_task [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 19:59:59 devstack cinder-volume[72319]: DEBUG cinder.volume.drivers.lvm [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] Updating volume stats {{(pid=72319) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 30 19:59:59 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 19:59:59 devstack sudo[78439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 30 19:59:59 devstack sudo[78439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:00:00 devstack sudo[78439]: pam_unix(sudo:session): session closed for user root
Sep 30 20:00:00 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.504s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:00 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:00 devstack sudo[78442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 20:00:00 devstack sudo[78442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:00:00 devstack sudo[78442]: pam_unix(sudo:session): session closed for user root
Sep 30 20:00:00 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:00 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:00 devstack sudo[78480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 30 20:00:00 devstack sudo[78480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:00:01 devstack sudo[78480]: pam_unix(sudo:session): session closed for user root
Sep 30 20:00:01 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:01 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:01 devstack sudo[78497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 30 20:00:01 devstack sudo[78497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:00:01 devstack sudo[78497]: pam_unix(sudo:session): session closed for user root
Sep 30 20:00:01 devstack cinder-volume[72319]: DEBUG oslo_concurrency.processutils [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=72319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:01 devstack cinder-volume[72319]: DEBUG cinder.manager [None req-c9b8179c-f5ba-40b0-ad3d-7a8800765842 None None] Notifying Schedulers of capabilities ... {{(pid=72319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:00:32 devstack cinder-volume[72319]: DEBUG dbcounter [-] [72319] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72319) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:00:44 devstack cinder-volume[72220]: INFO oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Caught SIGTERM, stopping children
Sep 30 20:00:44 devstack cinder-volume[72220]: DEBUG oslo_concurrency.lockutils [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Acquiring lock "singleton_lock" {{(pid=72220) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 20:00:44 devstack cinder-volume[72220]: DEBUG oslo_concurrency.lockutils [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Acquired lock "singleton_lock" {{(pid=72220) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 20:00:44 devstack cinder-volume[72220]: DEBUG oslo_concurrency.lockutils [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Releasing lock "singleton_lock" {{(pid=72220) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 20:00:44 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Stop services. {{(pid=72220) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 30 20:00:44 devstack cinder-volume[72220]: DEBUG oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Killing children. {{(pid=72220) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 30 20:00:44 devstack cinder-volume[72220]: INFO oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Waiting on 1 children to exit
Sep 30 20:00:45 devstack cinder-volume[72319]: DEBUG oslo_concurrency.lockutils [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Acquiring lock "singleton_lock" {{(pid=72319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 20:00:45 devstack cinder-volume[72319]: DEBUG oslo_concurrency.lockutils [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Acquired lock "singleton_lock" {{(pid=72319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 20:00:45 devstack cinder-volume[72319]: DEBUG oslo_concurrency.lockutils [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Releasing lock "singleton_lock" {{(pid=72319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 20:00:45 devstack cinder-volume[72319]: WARNING amqp [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 20:00:45 devstack cinder-volume[72319]: WARNING amqp [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 20:00:45 devstack cinder-volume[72220]: INFO oslo_service.backend._eventlet.service [None req-5707c56a-92be-44ba-8f11-2aa7628a76d3 None None] Child 72319 exited with status 0
Sep 30 20:00:47 devstack cinder-volume[79563]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=79563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 20:00:47 devstack cinder-volume[79563]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=79563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 20:00:47 devstack cinder-volume[79563]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=79563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 20:00:48 devstack cinder-volume[79563]: INFO dbcounter [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Registered counter for database cinder
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_db.sqlalchemy.engines [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG dbcounter [-] [79563] Writer thread running {{(pid=79563) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 20:00:48 devstack cinder-volume[79563]: INFO cinder.rpc [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 20:00:48 devstack cinder-volume[79563]: INFO cinder.rpc [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_db.sqlalchemy.engines [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 20:00:48 devstack cinder-volume[79563]: INFO cinder.volume.manager [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Determined volume DB was empty at startup.
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG cinder.volume.manager [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=79563) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 30 20:00:48 devstack cinder-volume[79563]: INFO cinder.volume.manager [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 30 20:00:48 devstack cinder-volume[79563]: WARNING stevedore.named [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 20:00:48 devstack cinder-volume[79563]: WARNING castellan.key_manager [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 20:00:48 devstack cinder-volume[79563]: WARNING cinder.keymgr.conf_key_mgr [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 20:00:48 devstack cinder-volume[79563]: INFO cinder.volume.manager [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_db.sqlalchemy.engines [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 20:00:48 devstack cinder-volume[79563]: INFO oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Starting 1 workers
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Started child 79660 {{(pid=79563) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Full set of CONF: {{(pid=79563) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] ******************************************************************************** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Configuration options gathered from: {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] ================================================================================ {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] allow_availability_zone_fallback = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] allow_compression_on_image_upload = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] allowed_direct_url_schemes     = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] api_rate_limit                 = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] auth_strategy                  = keystone {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_availability_zone      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_host                   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_name                   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_stats_polling_interval = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backup_api_class               = cinder.backup.api.API {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backup_name_template           = backup-%s {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backup_use_same_host           = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backup_use_temp_snapshot       = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79660]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] chap_password                  = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] chap_username                  =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_internal_tenant_project_id = 1fe5c509b2144bb280efb8c57dbe4ce3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_internal_tenant_user_id = 66d62f2a8211448c87d76ca24bf48797 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cluster                        = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] compression_format             = gzip {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] config_dir                     = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] config_source                  = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] control_exchange               = openstack {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] debug                          = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] default_availability_zone      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] default_group_type             = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] default_volume_type            = QuobyteHD {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] driver_client_cert             = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] driver_client_cert_key         = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] driver_data_namespace          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] driver_ssl_cert_path           = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] driver_ssl_cert_verify         = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] driver_use_ssl                 = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] enable_new_services            = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] enable_unsupported_driver      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] enabled_backends               = ['QuobyteHD'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] enforce_multipath_for_image_xfer = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] filter_function                = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_api_insecure            = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_api_ssl_compression     = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_ca_certificates_file    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_certfile                = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_keyfile                 = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_num_retries             = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance_request_timeout         = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] goodness_function              = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] graceful_shutdown_timeout      = 5 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] group_api_class                = cinder.group.api.API {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] host                           = devstack {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_compress_on_upload       = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_conversion_address_space_limit = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_conversion_cpu_limit     = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_conversion_disable       = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_upload_use_cinder_backend = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_upload_use_internal_tenant = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_volume_cache_enabled     = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_volume_cache_max_count   = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] image_volume_cache_max_size_gb = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] init_host_max_objects_retrieval = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] iscsi_iotype                   = fileio {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] iscsi_target_flags             =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] iscsi_write_cache              = on {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] iser_helper                    = tgtadm {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] iser_ip_address                = 192.168.122.53 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] iser_port                      = 3260 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_color                      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_config_append              = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_dir                        = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_file                       = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_options                    = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_rotate_interval            = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_rotate_interval_type       = days {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] log_rotation_type              = none {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] max_age                        = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] max_logfile_count              = 30 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] max_logfile_size_mb            = 200 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] max_over_subscription_ratio    = 20.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] message_reap_interval          = 86400 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] message_ttl                    = 2592000 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] migration_create_volume_timeout_secs = 300 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] monkey_patch                   = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] monkey_patch_modules           = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] my_ip                          = 192.168.122.53 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] no_snapshot_gb_quota           = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] num_iser_scan_tries            = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] num_shell_tries                = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] num_volume_device_scan_tries   = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] nvmeof_conn_info_version       = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] nvmet_ns_id                    = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] nvmet_port_id                  = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] osapi_max_limit                = 1000 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] osapi_volume_ext_list          = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] osapi_volume_listen_port       = 8776 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] osapi_volume_use_ssl           = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] osapi_volume_workers           = 2 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] per_volume_size_limit          = -1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] periodic_fuzzy_delay           = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] periodic_interval              = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] public_endpoint                = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] publish_errors                 = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] quota_backup_gigabytes         = 1000 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] quota_backups                  = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] quota_gigabytes                = 1000 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] quota_groups                   = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79660]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:00:48 devstack cinder-volume[79660]: INFO cinder.volume.manager [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 30 20:00:48 devstack cinder-volume[79660]: DEBUG cinder.volume.drivers.remotefs [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=79660) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] quota_snapshots                = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] quota_volumes                  = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] rate_limit_burst               = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] rate_limit_except_level        = CRITICAL {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] rate_limit_interval            = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] reinit_driver_count            = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] replication_device             = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] report_discard_supported       = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] report_interval                = 120 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] reservation_clean_interval     = 86400 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] reservation_expire             = 86400 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] reserved_image_namespaces      = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] reserved_percentage            = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] rpc_response_timeout           = 120 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] run_external_periodic_tasks    = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] scst_target_driver             = iscsi {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] scst_target_iqn_name           = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_down_time              = 720 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] shell_completion               = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] snapshot_name_template         = snapshot-%s {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] split_loggers                  = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] state_path                     = /opt/stack/data/cinder {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] storage_availability_zone      = nova {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] storage_protocol               = iSCSI {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] syslog_log_facility            = LOG_USER {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] target_helper                  = lioadm {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] target_ip_address              = 192.168.122.53 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] target_port                    = 3260 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] target_protocol                = iscsi {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] target_secondary_ip_addresses  = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] trace_flags                    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] transport_url                  = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] until_refresh                  = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] use_chap_auth                  = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] use_default_quota_class        = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] use_journal                    = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] use_json                       = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] use_multipath_for_image_xfer   = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] use_stderr                     = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] use_syslog                     = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] verify_glance_signatures       = enabled {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_api_class               = cinder.volume.api.API {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_backend_name            = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_clear                   = zero {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_clear_ionice            = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_clear_size              = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_copy_bps_limit          = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_dd_blocksize            = 1M {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_name_template           = volume-%s {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_service_inithost_offload = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volume_usage_audit_period      = month {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] watch_log_file                 = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] zoning_mode                    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_concurrency.disable_process_locking = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.admin_password = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.admin_token = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.admin_user  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.auth_port   = 35357 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.auth_protocol = https {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.auth_section = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.auth_type   = password {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.auth_uri    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.auth_version = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.cache       = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.certfile    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.identity_uri = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.include_service_catalog = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.insecure    = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.interface   = public {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.keyfile     = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_password =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcache_username =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.region_name = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.service_type = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.backend                  = dogpile.cache.null {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.backend_argument         = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.backend_expiration_time  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.config_prefix            = cache.oslo {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.dead_timeout             = 60.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.debug_cache_backend      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.enable_retry_client      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.enable_socket_keepalive  = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.enabled                  = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.enforce_fips_mode        = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.expiration_time          = 600 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.hashclient_retry_attempts = 2 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_dead_retry      = 300 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_password        = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_sasl_enabled    = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.memcache_username        = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.proxies                  = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.redis_db                 = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.redis_password           = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.redis_server             = localhost:6379 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.redis_socket_timeout     = 1.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.redis_username           = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.retry_attempts           = 2 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.retry_delay              = 0.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.socket_keepalive_count   = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.socket_keepalive_idle    = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.socket_keepalive_interval = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.tls_allowed_ciphers      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.tls_cafile               = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.tls_certfile             = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.tls_enabled              = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cache.tls_keyfile              = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] coordination.backend_url       = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.asyncio_connection    = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.asyncio_slave_connection = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.backend               = sqlalchemy {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.connection            = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.connection_debug      = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.connection_parameters =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.connection_recycle_time = 3600 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.connection_trace      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.db_inc_retry_interval = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.db_max_retries        = 20 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.db_max_retry_interval = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.db_retry_interval     = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.max_overflow          = 50 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.max_pool_size         = 5 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.max_retries           = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.mysql_wsrep_sync_wait = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.pool_timeout          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.retry_interval        = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.slave_connection      = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.sqlite_synchronous    = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] database.use_db_reconnect      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.connection_string     = messaging:// {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.enabled               = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.es_doc_type           = notification {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.es_scroll_size        = 10000 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.es_scroll_time        = 2m {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.filter_error_trace    = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.hmac_keys             = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.sentinel_service_name = mymaster {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.socket_timeout        = 0.1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.trace_requests        = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler.trace_sqlalchemy      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler_jaeger.process_tags   = {} {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler_jaeger.service_name_prefix = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] profiler_otlp.service_name_prefix = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.enforce_new_defaults = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: WARNING oslo_config.cfg [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.enforce_scope      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.policy_default_rule = default {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] privsep_osbrick.group          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] privsep_osbrick.helper_command = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] privsep_osbrick.user           = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_sys_admin.group         = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79660]: DEBUG cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=79660) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 30 20:00:48 devstack cinder-volume[79660]: INFO cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 30 20:00:48 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Running cmd (subprocess): mount.quobyte {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_sys_admin.helper_command = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] cinder_sys_admin.user          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.auth_section      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.auth_type         = password {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.certfile          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.collect_timing    = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.insecure          = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.keyfile           = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.send_service_user_token = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.split_loggers     = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] service_user.timeout           = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.auth_section            = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.auth_type               = password {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.certfile                = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.collect_timing          = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.insecure                = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.keyfile                 = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.split_loggers           = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] glance.timeout                 = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.backend_availability_zone = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.chap_password = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.chap_username =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.driver_client_cert = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.driver_client_cert_key = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.driver_data_namespace = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.driver_use_ssl = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.extra_capabilities = {} {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.filter_function = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.goodness_function = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.iscsi_target_flags =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.iscsi_write_cache = on {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.iser_port     = 3260 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_host      =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_login     = admin {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_mount_options = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_password  = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_private_key =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_share_path =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.num_shell_tries = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.quobyte_volume_url = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.replication_device = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.report_discard_supported = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.reserved_percentage = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.target_helper = tgtadm {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.target_port   = 3260 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.target_protocol = iscsi {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.trace_flags   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.unique_fqdn_network = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.use_chap_auth = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volume_backend_name = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volume_clear  = zero {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volume_clear_ionice = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volume_clear_size = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_reports.file_event_handler = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_reports.log_dir           = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.backend_availability_zone = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.backend_host         = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.chap_password        = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.chap_username        = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.chiscsi_conf         = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.driver_client_cert   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.driver_data_namespace = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.driver_use_ssl       = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.extra_capabilities   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.filter_function      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.goodness_function    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.iscsi_iotype         = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.iser_helper          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.iser_ip_address      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.iser_port            = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.iser_target_prefix   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_host             = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_login            = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_mount_options    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_password         = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_private_key      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_share_path       = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_ssh_port         = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.num_shell_tries      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.nvmet_port_id        = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.replication_device   = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.report_discard_supported = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.reserved_percentage  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.scst_target_driver   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.storage_protocol     = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.target_helper        = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.target_ip_address    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.target_port          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.target_prefix        = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.target_protocol      = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.trace_flags          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.use_chap_auth        = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volume_clear         = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volume_clear_size    = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] QuobyteHD.volumes_dir          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_notifications.driver = [] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_notifications.retry = -1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] key_manager.fixed_key          = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.barbican_api_version  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.barbican_endpoint     = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.barbican_endpoint_type = public {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.barbican_region_name  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.cafile                = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack quobyte-client[79691]: Reading configuration file: /etc/quobyte/client.cfg
Sep 30 20:00:48 devstack quobyte-client[79691]: Invalid parameters found, error: missing mount point.
Sep 30 20:00:48 devstack quobyte-client[79691]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 30 20:00:48 devstack quobyte-client[79691]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.certfile              = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.collect_timing        = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.insecure              = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.keyfile               = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.number_of_retries     = 60 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.retry_delay           = 1 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.send_service_user_token = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.split_loggers         = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.timeout               = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.verify_ssl            = True {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican.verify_ssl_path       = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.auth_section = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.auth_type = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.cafile   = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.certfile = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.collect_timing = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.insecure = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.keyfile  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.split_loggers = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] barbican_service_user.timeout  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.approle_role_id          = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] CMD "mount.quobyte" returned: 1 in 0.194s {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.approle_secret_id        = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:00:48 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:00:48 devstack cinder-volume[79660]: DEBUG cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.kv_mountpoint            = secret {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.kv_path                  = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79660]: INFO cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e ...
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.kv_version               = 2 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 -c /etc/quobyte/client-cinder.cfg {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.namespace                = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.root_token_id            = **** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.ssl_ca_crt_file          = None {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.timeout                  = 60.0 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.use_ssl                  = False {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:48 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] ******************************************************************************** {{(pid=79563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 30 20:00:49 devstack quobyte-client[79695]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 30 20:00:49 devstack quobyte-client[79695]: Reading configuration file: /etc/quobyte/client.cfg
Sep 30 20:00:49 devstack quobyte-client[79695]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022' to display the log.
Sep 30 20:00:49 devstack quobyte-client[79699]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 30 20:00:49 devstack quobyte-client[79699]: mount.quobyte 4.5 (2027c5892c)
Sep 30 20:00:49 devstack quobyte-client[79699]: Client UUID: NPKBIpN3-NQWY-Bmxj-EMyt-xWjDt7MvfxHC
Sep 30 20:00:49 devstack quobyte-client[79699]: Registry: osci02.corp.quobyte.com:7861
Sep 30 20:00:49 devstack quobyte-client[79699]: Volume: cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:00:49 devstack quobyte-client[79699]: FUSE version: 316
Sep 30 20:00:49 devstack quobyte-client[79699]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 30 20:00:49 devstack quobyte-client[79699]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 30 20:00:49 devstack quobyte-client[79699]: Setting total object cache size to 5038407680 bytes
Sep 30 20:00:49 devstack quobyte-client[79699]: Using FUSE low-level API
Sep 30 20:00:49 devstack quobyte-client[79699]: Caching of uid/gid to user/group name mappings is enabled
Sep 30 20:00:49 devstack quobyte-client[79699]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 30 20:00:49 devstack quobyte-client[79699]: HTTP server started on port 55000
Sep 30 20:00:49 devstack quobyte-client[79699]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 30 20:00:49 devstack quobyte-client[79699]: Mount point /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 established
Sep 30 20:00:49 devstack quobyte-client[79699]: TimeSync is running and remote sync every 60 seconds
Sep 30 20:00:49 devstack quobyte-client[79699]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 20:00:49 devstack quobyte-client[79699]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 20:00:49 devstack quobyte-client[79699]: Opening volume cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e (584744b4-c010-424f-99b5-4037d32ed6f3)
Sep 30 20:00:49 devstack quobyte-client[79699]: Setting metadata cache size to 1000000 based on available system memory of 23 GiB
Sep 30 20:00:49 devstack quobyte-client[79699]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 20:00:49 devstack quobyte-client[79699]: Changed metadata cache configuration for volume 584744b4-c010-424f-99b5-4037d32ed6f3 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 30 20:00:49 devstack quobyte-client[79699]: Failed to invalidate inode: 38: Function not implemented
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] CMD "mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.169s {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:49 devstack cinder-volume[79660]: INFO cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e succeeded
Sep 30 20:00:49 devstack quobyte-client[79699]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 20:00:49 devstack quobyte-client[79699]: Automatic minidump upload enabled by global system configuration
Sep 30 20:00:49 devstack quobyte-client[79699]: Announcing HTTP status server address 172.24.4.1
Sep 30 20:00:49 devstack quobyte-client[79699]: Registered as service (uuid NPKBIpN3-NQWY-Bmxj-EMyt-xWjDt7MvfxHC)
Sep 30 20:00:49 devstack quobyte-client[79699]: Quobyte Client running as pid 79699
Sep 30 20:00:49 devstack quobyte-client[79699]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 30 20:00:49 devstack quobyte-client[79699]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.196s {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:49 devstack quobyte-client[79699]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.036s {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:49 devstack cinder-volume[79660]: INFO cinder.volume.driver [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.volume.driver [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 231.08221435546875, 'free_capacity_gb': 231.08221435546875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=79660) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_db.sqlalchemy.engines [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79660) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG dbcounter [-] [79660] Writer thread running {{(pid=79660) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.db.sqlalchemy.api [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Building query based on filter {{(pid=79660) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.image.image_utils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=79660) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 30 20:00:49 devstack cinder-volume[79660]: INFO cinder.keymgr.migration [None req-ad590f4a-8f40-4aba-bb5c-462228c91652 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.029s {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.manager [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Notifying Schedulers of capabilities ... {{(pid=79660) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:00:49 devstack cinder-volume[79660]: INFO cinder.volume.manager [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Driver initialization completed successfully.
Sep 30 20:00:49 devstack cinder-volume[79660]: INFO cinder.manager [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Initiating service 3 cleanup
Sep 30 20:00:49 devstack cinder-volume[79660]: INFO cinder.manager [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Service 3 cleanup completed.
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.service [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Creating RPC server for service cinder-volume {{(pid=79660) start /opt/stack/cinder/cinder/service.py:239}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.service [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=79660) start /opt/stack/cinder/cinder/service.py:245}}
Sep 30 20:00:49 devstack cinder-volume[79660]: INFO cinder.volume.manager [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 30 20:00:49 devstack cinder-volume[79660]: WARNING cinder.volume.volume_utils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:00:49 devstack cinder-volume[79660]: WARNING cinder.volume.volume_utils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79660) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG cinder.volume.drivers.quobyte [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79660) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79660) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:49 devstack cinder-volume[79660]: DEBUG oslo_concurrency.processutils [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.030s {{(pid=79660) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:49 devstack cinder-volume[79660]: INFO cinder.volume.manager [None req-bb642839-14bc-49e9-b324-1bdfaf49b392 None None] Driver post RPC initialization completed successfully.
Sep 30 20:00:50 devstack cinder-volume[79563]: INFO oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Caught SIGTERM, stopping children
Sep 30 20:00:50 devstack cinder-volume[79563]: DEBUG oslo_concurrency.lockutils [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Acquiring lock "singleton_lock" {{(pid=79563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 20:00:50 devstack cinder-volume[79563]: DEBUG oslo_concurrency.lockutils [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Acquired lock "singleton_lock" {{(pid=79563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 20:00:50 devstack cinder-volume[79563]: DEBUG oslo_concurrency.lockutils [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Releasing lock "singleton_lock" {{(pid=79563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 20:00:50 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Stop services. {{(pid=79563) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 30 20:00:50 devstack cinder-volume[79563]: DEBUG oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Killing children. {{(pid=79563) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 30 20:00:50 devstack cinder-volume[79563]: INFO oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Waiting on 1 children to exit
Sep 30 20:00:51 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Acquiring lock "singleton_lock" {{(pid=79660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 20:00:51 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Acquired lock "singleton_lock" {{(pid=79660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 20:00:51 devstack cinder-volume[79660]: DEBUG oslo_concurrency.lockutils [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Releasing lock "singleton_lock" {{(pid=79660) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 20:00:51 devstack cinder-volume[79660]: WARNING amqp [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 20:00:51 devstack cinder-volume[79660]: WARNING amqp [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 30 20:00:51 devstack cinder-volume[79563]: INFO oslo_service.backend._eventlet.service [None req-122689f4-15e5-4ca5-8332-c406e45124e4 None None] Child 79660 exited with status 0
Sep 30 20:00:52 devstack quobyte-client[79699]: Resolving 'registry:' with default 10.10.41.20:7861
Sep 30 20:00:53 devstack cinder-volume[79868]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=79868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 30 20:00:53 devstack cinder-volume[79868]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=79868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 30 20:00:53 devstack cinder-volume[79868]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=79868) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 30 20:00:54 devstack cinder-volume[79868]: INFO dbcounter [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Registered counter for database cinder
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_db.sqlalchemy.engines [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG dbcounter [-] [79868] Writer thread running {{(pid=79868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 20:00:54 devstack cinder-volume[79868]: INFO cinder.rpc [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 30 20:00:54 devstack cinder-volume[79868]: INFO cinder.rpc [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_db.sqlalchemy.engines [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 20:00:54 devstack cinder-volume[79868]: INFO cinder.volume.manager [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Determined volume DB was empty at startup.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG cinder.volume.manager [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=79868) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 30 20:00:54 devstack cinder-volume[79868]: WARNING stevedore.named [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 30 20:00:54 devstack cinder-volume[79868]: WARNING castellan.key_manager [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 20:00:54 devstack cinder-volume[79868]: WARNING cinder.keymgr.conf_key_mgr [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 30 20:00:54 devstack cinder-volume[79868]: INFO cinder.volume.manager [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_db.sqlalchemy.engines [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 20:00:54 devstack cinder-volume[79868]: INFO oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Starting 1 workers
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Started child 79893 {{(pid=79868) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Full set of CONF: {{(pid=79868) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] ******************************************************************************** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Configuration options gathered from: {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] ================================================================================ {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0)
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] allow_availability_zone_fallback = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] allow_compression_on_image_upload = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] allowed_direct_url_schemes     = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] api_rate_limit                 = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] auth_strategy                  = keystone {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_availability_zone      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_host                   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_name                   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_stats_polling_interval = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backup_api_class               = cinder.backup.api.API {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backup_name_template           = backup-%s {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backup_use_same_host           = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backup_use_temp_snapshot       = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] chap_password                  = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] chap_username                  =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_internal_tenant_project_id = 1fe5c509b2144bb280efb8c57dbe4ce3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_internal_tenant_user_id = 66d62f2a8211448c87d76ca24bf48797 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cluster                        = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] compression_format             = gzip {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] compute_api_class              = cinder.compute.nova.API {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] config_dir                     = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] config_source                  = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] control_exchange               = openstack {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] debug                          = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] default_availability_zone      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] default_group_type             = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] default_volume_type            = QuobyteHD {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] driver_client_cert             = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] driver_client_cert_key         = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] driver_data_namespace          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] driver_ssl_cert_path           = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] driver_ssl_cert_verify         = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] driver_use_ssl                 = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] enable_new_services            = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] enable_unsupported_driver      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] enabled_backends               = ['QuobyteHD'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] enforce_multipath_for_image_xfer = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] filter_function                = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_api_insecure            = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_api_ssl_compression     = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_ca_certificates_file    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_catalog_info            = image:glance:publicURL {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_certfile                = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_keyfile                 = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_num_retries             = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance_request_timeout         = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] goodness_function              = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] graceful_shutdown_timeout      = 5 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] group_api_class                = cinder.group.api.API {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] host                           = devstack {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_compress_on_upload       = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_conversion_address_space_limit = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_conversion_cpu_limit     = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=79893) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_conversion_disable       = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_upload_use_cinder_backend = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_upload_use_internal_tenant = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_volume_cache_enabled     = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_volume_cache_max_count   = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] image_volume_cache_max_size_gb = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] init_host_max_objects_retrieval = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] instance_format                = [instance: %(uuid)s]  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] iscsi_iotype                   = fileio {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] iscsi_target_flags             =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] iscsi_write_cache              = on {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] iser_helper                    = tgtadm {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] iser_ip_address                = 192.168.122.53 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] iser_port                      = 3260 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_color                      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_config_append              = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_dir                        = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_file                       = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_options                    = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_rotate_interval            = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_rotate_interval_type       = days {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] log_rotation_type              = none {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] max_age                        = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] max_logfile_count              = 30 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] max_logfile_size_mb            = 200 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] max_over_subscription_ratio    = 20.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] message_reap_interval          = 86400 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] message_ttl                    = 2592000 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] migration_create_volume_timeout_secs = 300 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] monkey_patch                   = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] monkey_patch_modules           = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] my_ip                          = 192.168.122.53 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] no_snapshot_gb_quota           = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] num_iser_scan_tries            = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] num_shell_tries                = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] num_volume_device_scan_tries   = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] nvmeof_conn_info_version       = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] nvmet_ns_id                    = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] nvmet_port_id                  = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] osapi_max_limit                = 1000 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] osapi_volume_ext_list          = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] osapi_volume_listen_port       = 8776 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] osapi_volume_use_ssl           = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] osapi_volume_workers           = 2 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] per_volume_size_limit          = -1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] periodic_fuzzy_delay           = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] periodic_interval              = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] public_endpoint                = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] publish_errors                 = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] quota_backup_gigabytes         = 1000 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] quota_backups                  = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] quota_gigabytes                = 1000 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] quota_groups                   = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] quota_snapshots                = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] quota_volumes                  = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] rate_limit_burst               = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] rate_limit_except_level        = CRITICAL {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] rate_limit_interval            = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] reinit_driver_count            = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] replication_device             = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] report_discard_supported       = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] report_interval                = 120 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] reservation_clean_interval     = 86400 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] reservation_expire             = 86400 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] reserved_image_namespaces      = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] reserved_percentage            = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] rpc_response_timeout           = 120 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] run_external_periodic_tasks    = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] scst_target_driver             = iscsi {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] scst_target_iqn_name           = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_down_time              = 720 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] shell_completion               = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] snapshot_name_template         = snapshot-%s {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] split_loggers                  = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] state_path                     = /opt/stack/data/cinder {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] storage_availability_zone      = nova {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] storage_protocol               = iSCSI {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] syslog_log_facility            = LOG_USER {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] target_helper                  = lioadm {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] target_ip_address              = 192.168.122.53 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] target_port                    = 3260 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] target_protocol                = iscsi {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] target_secondary_ip_addresses  = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] trace_flags                    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] transport_url                  = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] until_refresh                  = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] use_chap_auth                  = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] use_default_quota_class        = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] use_journal                    = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] use_json                       = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] use_multipath_for_image_xfer   = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] use_stderr                     = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] use_syslog                     = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] verify_glance_signatures       = enabled {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_api_class               = cinder.volume.api.API {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_backend_name            = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_clear                   = zero {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_clear_ionice            = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_clear_size              = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_copy_bps_limit          = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_dd_blocksize            = 1M {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_name_template           = volume-%s {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_service_inithost_offload = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volume_usage_audit_period      = month {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] watch_log_file                 = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] zoning_mode                    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_concurrency.disable_process_locking = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.admin_password = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.admin_token = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.admin_user  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.auth_port   = 35357 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.auth_protocol = https {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.auth_section = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.auth_type   = password {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.auth_uri    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.auth_version = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.cache       = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.certfile    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.delay_auth_decision = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.http_connect_timeout = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.identity_uri = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.include_service_catalog = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.insecure    = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.interface   = public {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.keyfile     = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_password =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=79893) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.volume.drivers.quobyte [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Running cmd (subprocess): mount.quobyte {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcache_username =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.region_name = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.service_token_roles_required = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.service_type = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.token_cache_time = 300 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] keystone_authtoken.www_authenticate_uri = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.backend                  = dogpile.cache.null {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.backend_argument         = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.backend_expiration_time  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.config_prefix            = cache.oslo {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.dead_timeout             = 60.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.debug_cache_backend      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.enable_retry_client      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.enable_socket_keepalive  = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.enabled                  = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.enforce_fips_mode        = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.expiration_time          = 600 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.hashclient_retry_attempts = 2 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_dead_retry      = 300 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_password        = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_pool_maxsize    = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_sasl_enabled    = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.memcache_username        = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.proxies                  = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.redis_db                 = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.redis_password           = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.redis_sentinel_service_name = mymaster {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.redis_server             = localhost:6379 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.redis_socket_timeout     = 1.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.redis_username           = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.retry_attempts           = 2 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.retry_delay              = 0.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.socket_keepalive_count   = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.socket_keepalive_idle    = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.socket_keepalive_interval = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.tls_allowed_ciphers      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.tls_cafile               = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.tls_certfile             = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.tls_enabled              = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cache.tls_keyfile              = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] coordination.backend_url       = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.asyncio_connection    = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.asyncio_slave_connection = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.backend               = sqlalchemy {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.connection            = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.connection_debug      = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.connection_parameters =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.connection_recycle_time = 3600 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.connection_trace      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.db_inc_retry_interval = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.db_max_retries        = 20 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.db_max_retry_interval = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.db_retry_interval     = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.max_overflow          = 50 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.max_pool_size         = 5 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.max_retries           = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.mysql_wsrep_sync_wait = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.pool_timeout          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.retry_interval        = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.slave_connection      = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.sqlite_synchronous    = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] database.use_db_reconnect      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.connection_string     = messaging:// {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.enabled               = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.es_doc_type           = notification {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.es_scroll_size        = 10000 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.es_scroll_time        = 2m {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.filter_error_trace    = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.hmac_keys             = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.sentinel_service_name = mymaster {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.socket_timeout        = 0.1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.trace_requests        = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler.trace_sqlalchemy      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler_jaeger.process_tags   = {} {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler_jaeger.service_name_prefix = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] profiler_otlp.service_name_prefix = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.enforce_new_defaults = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: WARNING oslo_config.cfg [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.enforce_scope      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.policy_default_rule = default {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.policy_file        = policy.yaml {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] privsep_osbrick.group          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] privsep_osbrick.helper_command = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] privsep_osbrick.user           = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_sys_admin.group         = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_sys_admin.helper_command = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] cinder_sys_admin.user          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.auth_section      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.auth_type         = password {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.certfile          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.collect_timing    = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.insecure          = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.keyfile           = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.send_service_user_token = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.split_loggers     = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] service_user.timeout           = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.auth_section            = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.auth_type               = password {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.certfile                = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.collect_timing          = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.insecure                = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.keyfile                 = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.split_loggers           = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] glance.timeout                 = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.backend_availability_zone = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.chap_password = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.chap_username =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.driver_client_cert = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.driver_client_cert_key = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.driver_data_namespace = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.driver_use_ssl = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.enable_unsupported_driver = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.extra_capabilities = {} {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.filter_function = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.goodness_function = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.iscsi_iotype  = fileio {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.iscsi_target_flags =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.iscsi_write_cache = on {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.iser_helper   = tgtadm {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.iser_port     = 3260 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_host      =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_login     = admin {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_mount_options = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_password  = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack quobyte-client[79894]: Reading configuration file: /etc/quobyte/client.cfg
Sep 30 20:00:54 devstack quobyte-client[79894]: Invalid parameters found, error: missing mount point.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_private_key =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack quobyte-client[79894]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack quobyte-client[79894]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_share_path =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.num_shell_tries = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.nvmet_port_id = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.quobyte_client_cfg = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.quobyte_volume_url = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.replication_device = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.report_discard_supported = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.reserved_percentage = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.scst_target_driver = iscsi {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.scst_target_iqn_name = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.storage_protocol = iSCSI {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.target_helper = tgtadm {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.target_port   = 3260 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.target_protocol = iscsi {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.trace_flags   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.unique_fqdn_network = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.use_chap_auth = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volume_backend_name = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volume_clear  = zero {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volume_clear_ionice = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volume_clear_size = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_reports.file_event_handler = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_reports.log_dir           = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.backend_availability_zone = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.backend_host         = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.chap_password        = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.chap_username        = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.chiscsi_conf         = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.driver_client_cert   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.driver_client_cert_key = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.driver_data_namespace = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.driver_use_ssl       = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.extra_capabilities   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.filter_function      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.goodness_function    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.iscsi_iotype         = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.iser_helper          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.iser_ip_address      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.iser_port            = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.iser_target_prefix   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_host             = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_login            = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_mount_options    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_password         = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_private_key      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_secure_file_operations = true {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_share_path       = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_ssh_port         = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.volume.driver [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Driver hasn't implemented _init_vendor_properties()
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.driver [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 231.08221435546875, 'free_capacity_gb': 231.08221435546875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=79893) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.num_shell_tries      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.nvmet_port_id        = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.replication_device   = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.report_discard_supported = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.reserved_percentage  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.scst_target_driver   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.storage_protocol     = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.target_helper        = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.target_ip_address    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.target_port          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.target_prefix        = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.target_protocol      = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.trace_flags          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.use_chap_auth        = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volume_clear         = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volume_clear_size    = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_db.sqlalchemy.engines [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79893) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] QuobyteHD.volumes_dir          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.ssl      = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_notifications.driver = [] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_notifications.retry = -1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] oslo_messaging_notifications.transport_url = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] key_manager.fixed_key          = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.barbican_api_version  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.barbican_endpoint     = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.barbican_endpoint_type = public {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.barbican_region_name  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.cafile                = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.certfile              = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.collect_timing        = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.insecure              = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.keyfile               = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writer thread running {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.number_of_retries     = 60 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.retry_delay           = 1 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.send_service_user_token = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.split_loggers         = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.timeout               = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.verify_ssl            = True {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican.verify_ssl_path       = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.auth_section = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.auth_type = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.cafile   = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.certfile = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.collect_timing = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.insecure = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.keyfile  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.split_loggers = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] barbican_service_user.timeout  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.approle_role_id          = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.approle_secret_id        = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.kv_mountpoint            = secret {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.kv_path                  = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.kv_version               = 2 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.namespace                = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.db.sqlalchemy.api [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Building query based on filter {{(pid=79893) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.root_token_id            = **** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.ssl_ca_crt_file          = None {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.timeout                  = 60.0 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.use_ssl                  = False {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 30 20:00:54 devstack cinder-volume[79868]: DEBUG oslo_service.backend._eventlet.service [None req-200daf27-ac04-4eea-8ef2-9bd3f7fb617e None None] ******************************************************************************** {{(pid=79868) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=79893) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.keymgr.migration [None req-43b6d970-50c3-4290-aa5f-1f1d8876d80a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Driver initialization completed successfully.
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.manager [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Initiating service 3 cleanup
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.manager [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Service 3 cleanup completed.
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.service [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Creating RPC server for service cinder-volume {{(pid=79893) start /opt/stack/cinder/cinder/service.py:239}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.service [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=79893) start /opt/stack/cinder/cinder/service.py:245}}
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 30 20:00:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:00:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:00:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.015s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:00:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b84d8a3b-7d9e-4fa2-a2af-d232ec7ee18e None None] Driver post RPC initialization completed successfully.
Sep 30 20:01:04 devstack cinder-volume[79868]: DEBUG dbcounter [-] [79868] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=79868) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:01:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:01:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:02:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:03:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:02 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:03:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Flow 'volume_create_manager' (59551d55-6fd2-40c0-abbd-a3fa70cf6a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e83bd35-ac62-45c5-bd2b-8ede278faa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e83bd35-ac62-45c5-bd2b-8ede278faa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-480345732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796a7369-5564-4298-a7ee-0edca148994e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3296be86774284bf1eef4687acf47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:03Z,use_quota=True,user_id='588d2fd6b9d04ee9abfb5b933ce5c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c9e473-7440-46f5-855c-adab37f7ec0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c9e473-7440-46f5-855c-adab37f7ec0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06c93a6-077e-412e-aa18-8256723d7f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:02 devstack cinder-volume[79893]: DEBUG cinder.image.glance [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Creating Keystone auth plugin from conf {{(pid=79893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 20:03:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06c93a6-077e-412e-aa18-8256723d7f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '796a7369-5564-4298-a7ee-0edca148994e', 'volume_name': 'volume-796a7369-5564-4298-a7ee-0edca148994e', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e1acd90>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d718dc-fb1b-42d5-a620-f8c319da45a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d718dc-fb1b-42d5-a620-f8c319da45a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70d1364-b088-4848-a97e-34c3d57d14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:03 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Volume 796a7369-5564-4298-a7ee-0edca148994e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-796a7369-5564-4298-a7ee-0edca148994e', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e1acd90>}
Sep 30 20:03:03 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Cloning 796a7369-5564-4298-a7ee-0edca148994e from image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]). {{(pid=79893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 30 20:03:04 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD, size 20.69 MB, duration 1.22 sec {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 20:03:04 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Image download 20.69 MB at 16.93 MB/s
Sep 30 20:03:04 devstack cinder-volume[79893]: INFO oslo.privsep.daemon [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps4xoipxg/privsep.sock']
Sep 30 20:03:04 devstack sudo[80459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps4xoipxg/privsep.sock
Sep 30 20:03:04 devstack sudo[80459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:03:05 devstack sudo[80459]: pam_unix(sudo:session): session closed for user root
Sep 30 20:03:05 devstack cinder-volume[79893]: INFO oslo.privsep.daemon [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Spawned new privsep daemon via rootwrap
Sep 30 20:03:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Accepted privsep connection to /tmp/tmps4xoipxg/privsep.sock {{(pid=79893) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 30 20:03:05 devstack cinder-volume[79893]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 30 20:03:05 devstack cinder-volume[79893]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 30 20:03:05 devstack cinder-volume[79893]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 30 20:03:05 devstack cinder-volume[79893]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80463
Sep 30 20:03:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[14561710-c89a-4333-a7b8-34263b95b210]: (2,) {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b875ca0e-9ad1-4caf-a6a4-a4c0d0d9d478]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:06 devstack sudo[80465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD
Sep 30 20:03:06 devstack sudo[80465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:03:06 devstack sudo[80465]: pam_unix(sudo:session): session closed for user root
Sep 30 20:03:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD" returned: 0 in 0.626s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:06 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Temporary image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 is fetched for user 588d2fd6b9d04ee9abfb5b933ce5c9a5. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 20:03:06 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a06c09b-41f3-4acd-90ad-e098837f6900]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:06 devstack sudo[80471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD
Sep 30 20:03:06 devstack sudo[80471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:03:07 devstack sudo[80471]: pam_unix(sudo:session): session closed for user root
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD" returned: 0 in 0.674s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-480345732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796a7369-5564-4298-a7ee-0edca148994e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3296be86774284bf1eef4687acf47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:03Z,use_quota=True,user_id='588d2fd6b9d04ee9abfb5b933ce5c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Creating volume 796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:03:07 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:07 devstack quobyte-client[79699]: System call "create" of process 80476 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:07 devstack quobyte-client[79699]: System call "getattr" of process 80476 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:07 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=2, name=volume-796a7369-5564-4298-a7ee-0edca148994e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e 1073741824" returned: 0 in 0.188s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] <== create_volume: return (217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.221s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Attempting download of d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}])) to volume 796a7369-5564-4298-a7ee-0edca148994e. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7757f725-fa45-41ff-8068-d67e7fdf0484]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_53n1p2a5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_53n1p2a5" returned: 0 in 0.136s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_53n1p2a5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_53n1p2a5" returned: 1 in 0.177s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_53n1p2a5' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48252ed-14eb-436e-a3ab-43866febee0f]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD" returned: 0 in 0.153s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 was qcow2, converting to raw {{(pid=79893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:08 devstack quobyte-client[79699]: System call "getattr" of process 80800 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:08 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=2, name=volume-796a7369-5564-4298-a7ee-0edca148994e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 0 in 0.394s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1__dxjgj3jdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:03:08 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e 1G" returned: 0 in 0.091s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be23d38-ce1d-46c6-a296-0ec95c33fb8b]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 0 in 0.146s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:08 devstack quobyte-client[79699]: System call "open" of process 80810 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 1 in 0.174s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Downloaded image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}])) to volume 796a7369-5564-4298-a7ee-0edca148994e successfully. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Temporary image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 for user 588d2fd6b9d04ee9abfb5b933ce5c9a5 is deleted. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Marking volume 796a7369-5564-4298-a7ee-0edca148994e as bootable. {{(pid=79893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Copying metadata from image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 to 796a7369-5564-4298-a7ee-0edca148994e. {{(pid=79893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Creating volume glance metadata for volume 796a7369-5564-4298-a7ee-0edca148994e backed by image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=79893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70d1364-b088-4848-a97e-34c3d57d14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796a7369-5564-4298-a7ee-0edca148994e', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e1acd90>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25aa8cf-cb13-402c-838b-77b278be1d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:08 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Volume volume-796a7369-5564-4298-a7ee-0edca148994e (796a7369-5564-4298-a7ee-0edca148994e): created successfully
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25aa8cf-cb13-402c-838b-77b278be1d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Flow 'volume_create_manager' (59551d55-6fd2-40c0-abbd-a3fa70cf6a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:09 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-626a700e-b7f0-4fb4-b03d-5c124c833f0e tempest-TaggedBootDevicesTest-959373523 None] Created volume successfully.
Sep 30 20:03:09 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Flow 'volume_create_manager' (cfc2ddf4-99e1-4fbc-9584-884c155fe07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9801797b-1499-4ad3-9bed-c6b6ba79b389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9801797b-1499-4ad3-9bed-c6b6ba79b389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1488486311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ad728b-0e77-4734-987d-69c5a2dac7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3296be86774284bf1eef4687acf47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:10Z,use_quota=True,user_id='588d2fd6b9d04ee9abfb5b933ce5c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69da00c4-230e-4e58-af52-6854b1e87b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69da00c4-230e-4e58-af52-6854b1e87b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974558ba-380a-4af0-a78c-3850573a7042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974558ba-380a-4af0-a78c-3850573a7042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ad728b-0e77-4734-987d-69c5a2dac7ab', 'volume_name': 'volume-28ad728b-0e77-4734-987d-69c5a2dac7ab', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fdf077-f30a-4ca8-94ac-aa1608a043b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98fdf077-f30a-4ca8-94ac-aa1608a043b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94be325b-fec0-4625-87d6-0156dbd40162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:09 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Volume 28ad728b-0e77-4734-987d-69c5a2dac7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ad728b-0e77-4734-987d-69c5a2dac7ab', 'volume_size': 1}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1488486311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ad728b-0e77-4734-987d-69c5a2dac7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3296be86774284bf1eef4687acf47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:10Z,use_quota=True,user_id='588d2fd6b9d04ee9abfb5b933ce5c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Creating volume 28ad728b-0e77-4734-987d-69c5a2dac7ab {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:03:09 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:09 devstack quobyte-client[79699]: System call "open" of process 80830 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:09 devstack quobyte-client[79699]: System call "ioctl" of process 80830 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:09 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=3, name=volume-28ad728b-0e77-4734-987d-69c5a2dac7ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab 1073741824" returned: 0 in 0.158s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] <== create_volume: return (193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:03:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.196s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94be325b-fec0-4625-87d6-0156dbd40162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ad728b-0e77-4734-987d-69c5a2dac7ab', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000a19f3-1021-4649-bbdf-67d66896e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:10 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Volume volume-28ad728b-0e77-4734-987d-69c5a2dac7ab (28ad728b-0e77-4734-987d-69c5a2dac7ab): created successfully
Sep 30 20:03:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000a19f3-1021-4649-bbdf-67d66896e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Flow 'volume_create_manager' (cfc2ddf4-99e1-4fbc-9584-884c155fe07d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:10 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b5bd3d2b-2903-4dfd-8ecd-02504454a9ba tempest-TaggedBootDevicesTest-959373523 None] Created volume successfully.
Sep 30 20:03:11 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Flow 'volume_create_manager' (67495f59-5cc2-499d-bcc7-e62355305b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01795250-2657-4b88-aa87-6ae2f18b7535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01795250-2657-4b88-aa87-6ae2f18b7535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-371795320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3296be86774284bf1eef4687acf47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:11Z,use_quota=True,user_id='588d2fd6b9d04ee9abfb5b933ce5c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afafc0e-b9d2-416e-b5db-aa9843419fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afafc0e-b9d2-416e-b5db-aa9843419fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0d1c36-935e-4f74-bd99-fb64e31edf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa0d1c36-935e-4f74-bd99-fb64e31edf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec', 'volume_name': 'volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3370dfef-01a3-452a-b37f-e18b5341cc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3370dfef-01a3-452a-b37f-e18b5341cc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8089d5ea-27da-4ba1-9240-5d545886b1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:11 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Volume b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec', 'volume_size': 1}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-371795320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f3296be86774284bf1eef4687acf47c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:11Z,use_quota=True,user_id='588d2fd6b9d04ee9abfb5b933ce5c9a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Creating volume b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:03:11 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:11 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=4, name=volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec 1073741824" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] <== create_volume: return (180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.182s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8089d5ea-27da-4ba1-9240-5d545886b1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48718da0-0503-4a35-aeab-ceedc6a93609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:11 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Volume volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec (b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec): created successfully
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48718da0-0503-4a35-aeab-ceedc6a93609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Flow 'volume_create_manager' (67495f59-5cc2-499d-bcc7-e62355305b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:11 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-33dc1150-853a-46f2-a9f0-b423b8133dc2 tempest-TaggedBootDevicesTest-959373523 None] Created volume successfully.
Sep 30 20:03:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:03:12 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Flow 'volume_create_manager' (98f1a25b-ee50-4aac-aca4-03252b1f5544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb6edbf-167e-4bfe-990a-8dfcd80fd931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb6edbf-167e-4bfe-990a-8dfcd80fd931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-730268789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeadf12b-81e5-4eab-9d46-d76de414fd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e76f0398714e04aac984d3f648ed60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:12Z,use_quota=True,user_id='f16ef65335bc44ffb9d403bcb70f8bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2974a4-e764-444c-aea5-f04a4b24a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2974a4-e764-444c-aea5-f04a4b24a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfa894d-7d72-4ee5-80ba-ceeefae6691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dfa894d-7d72-4ee5-80ba-ceeefae6691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeadf12b-81e5-4eab-9d46-d76de414fd57', 'volume_name': 'volume-aeadf12b-81e5-4eab-9d46-d76de414fd57', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e43312f-2c42-4456-9f20-7a1e95ff8837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e43312f-2c42-4456-9f20-7a1e95ff8837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fc39b6-a44c-422d-9365-d5eab6fb6ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:12 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Volume aeadf12b-81e5-4eab-9d46-d76de414fd57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeadf12b-81e5-4eab-9d46-d76de414fd57', 'volume_size': 1}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-730268789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeadf12b-81e5-4eab-9d46-d76de414fd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e76f0398714e04aac984d3f648ed60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:12Z,use_quota=True,user_id='f16ef65335bc44ffb9d403bcb70f8bd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Creating volume aeadf12b-81e5-4eab-9d46-d76de414fd57 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:03:12 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:12 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=5, name=volume-aeadf12b-81e5-4eab-9d46-d76de414fd57, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57 1073741824" returned: 0 in 0.146s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57" returned: 0 in 0.026s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] <== create_volume: return (182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.185s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fc39b6-a44c-422d-9365-d5eab6fb6ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeadf12b-81e5-4eab-9d46-d76de414fd57', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e155e52-91ff-427c-ba54-5a894cd11827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:12 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Volume volume-aeadf12b-81e5-4eab-9d46-d76de414fd57 (aeadf12b-81e5-4eab-9d46-d76de414fd57): created successfully
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e155e52-91ff-427c-ba54-5a894cd11827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:12 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Flow 'volume_create_manager' (98f1a25b-ee50-4aac-aca4-03252b1f5544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:12 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5c40b3d7-4118-4ec1-bd94-1050ccfd20f1 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Created volume successfully.
Sep 30 20:03:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:03:22 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=10,cinder:SELECT=21,cinder:INSERT=13,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:03:22 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=3,cinder:UPDATE=10,cinder:DELETE=3 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:03:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:22 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:03:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Flow 'volume_create_manager' (f5beecc6-e48e-4a17-932c-b8d2090b6017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b23fb2f-d8d0-471e-b124-dffca9a59ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b23fb2f-d8d0-471e-b124-dffca9a59ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-145464443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471b37d7-6a85-4a8b-abe2-146fda5bf5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baec1ae0f294dd9bf040448bbd29a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:23Z,use_quota=True,user_id='788847ccd1b646bc85ccdcfa7a2453c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0f4d14-6f03-4ec4-9ea5-73716bcd18d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0f4d14-6f03-4ec4-9ea5-73716bcd18d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c646e2-8296-45bf-a71f-09c866e76c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c646e2-8296-45bf-a71f-09c866e76c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471b37d7-6a85-4a8b-abe2-146fda5bf5a6', 'volume_name': 'volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ddf020-55ca-4d56-8849-4d09b3a11c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ddf020-55ca-4d56-8849-4d09b3a11c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7443bc1b-4f4b-4f1a-83f7-e354181501ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Volume 471b37d7-6a85-4a8b-abe2-146fda5bf5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6', 'volume_size': 1}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-145464443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471b37d7-6a85-4a8b-abe2-146fda5bf5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baec1ae0f294dd9bf040448bbd29a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:23Z,use_quota=True,user_id='788847ccd1b646bc85ccdcfa7a2453c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Creating volume 471b37d7-6a85-4a8b-abe2-146fda5bf5a6 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:03:23 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:23 devstack quobyte-client[79699]: System call "lookup" of process 81010 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:23 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=6, name=volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6 1073741824" returned: 0 in 0.577s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6" returned: 0 in 0.041s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] <== create_volume: return (641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.646s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7443bc1b-4f4b-4f1a-83f7-e354181501ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73efd6c2-7cf1-4117-8a12-682f2d48bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Volume volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6 (471b37d7-6a85-4a8b-abe2-146fda5bf5a6): created successfully
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73efd6c2-7cf1-4117-8a12-682f2d48bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Flow 'volume_create_manager' (f5beecc6-e48e-4a17-932c-b8d2090b6017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:23 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-568e6dd4-1e99-4c0e-97c9-75448ddcf1d2 tempest-DeleteServersTestJSON-1979545069 None] Created volume successfully.
Sep 30 20:03:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:03:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-0bdef4f5-a8b4-473c-b34c-9ad7e6ae4c1d req-063fe7f4-6c2f-430b-9b8d-8733ff667a54 tempest-DeleteServersTestJSON-1979545069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-0bdef4f5-a8b4-473c-b34c-9ad7e6ae4c1d req-063fe7f4-6c2f-430b-9b8d-8733ff667a54 tempest-DeleteServersTestJSON-1979545069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:30 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e382ce7-e773-488c-bfc5-1892a6d4d64b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-0bdef4f5-a8b4-473c-b34c-9ad7e6ae4c1d req-063fe7f4-6c2f-430b-9b8d-8733ff667a54 tempest-DeleteServersTestJSON-1979545069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-0bdef4f5-a8b4-473c-b34c-9ad7e6ae4c1d req-063fe7f4-6c2f-430b-9b8d-8733ff667a54 tempest-DeleteServersTestJSON-1979545069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6" returned: 0 in 0.173s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-0bdef4f5-a8b4-473c-b34c-9ad7e6ae4c1d req-063fe7f4-6c2f-430b-9b8d-8733ff667a54 tempest-DeleteServersTestJSON-1979545069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.210s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:30 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-0bdef4f5-a8b4-473c-b34c-9ad7e6ae4c1d req-063fe7f4-6c2f-430b-9b8d-8733ff667a54 tempest-DeleteServersTestJSON-1979545069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23e2f838-6e52-491a-b9d4-50e8789f2de5', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:03:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-0bdef4f5-a8b4-473c-b34c-9ad7e6ae4c1d req-063fe7f4-6c2f-430b-9b8d-8733ff667a54 tempest-DeleteServersTestJSON-1979545069 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-0bdef4f5-a8b4-473c-b34c-9ad7e6ae4c1d req-063fe7f4-6c2f-430b-9b8d-8733ff667a54 tempest-DeleteServersTestJSON-1979545069 None] attachment_update completed successfully.
Sep 30 20:03:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:03:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:34 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f726a5fd-92a5-4fd7-a9bd-c3b3f433990b]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 0 in 0.207s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:35 devstack quobyte-client[79699]: System call "getattr" of process 81601 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:35 devstack quobyte-client[79699]: System call "lookup" of process 81601 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:35 devstack quobyte-client[79699]: System call "getattr" of process 81601 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:35 devstack quobyte-client[79699]: System call "open" of process 81601 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 1 in 0.336s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:03:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.615s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-796a7369-5564-4298-a7ee-0edca148994e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5e33259-9d74-4237-993d-6f17e6640ee6', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:03:35 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-e22fbee6-3dd3-4533-8c9f-f147351f1a09 tempest-TaggedBootDevicesTest-959373523 None] attachment_update completed successfully.
Sep 30 20:03:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-1fc89a9e-0c89-49c3-9997-70538de117b9 tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-1fc89a9e-0c89-49c3-9997-70538de117b9 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:37 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8683e8-b140-4935-a550-acffa0ed2306]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-1fc89a9e-0c89-49c3-9997-70538de117b9 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:38 devstack quobyte-client[79699]: System call "getattr" of process 81636 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:38 devstack quobyte-client[79699]: System call "open" of process 81636 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-1fc89a9e-0c89-49c3-9997-70538de117b9 tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab" returned: 0 in 0.584s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-1fc89a9e-0c89-49c3-9997-70538de117b9 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.675s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-1fc89a9e-0c89-49c3-9997-70538de117b9 tempest-TaggedBootDevicesTest-959373523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-28ad728b-0e77-4734-987d-69c5a2dac7ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da702759-773e-490d-8751-61d4310a8ae9', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:03:38 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-1fc89a9e-0c89-49c3-9997-70538de117b9 tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:38 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-1fc89a9e-0c89-49c3-9997-70538de117b9 tempest-TaggedBootDevicesTest-959373523 None] attachment_update completed successfully.
Sep 30 20:03:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-c1c77acf-3b6b-45c2-9260-653d0a7bf100 tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-c1c77acf-3b6b-45c2-9260-653d0a7bf100 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:40 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb555e1-a829-40d2-b7c9-b0aded67f269]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-c1c77acf-3b6b-45c2-9260-653d0a7bf100 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:40 devstack quobyte-client[79699]: System call "open" of process 81696 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-c1c77acf-3b6b-45c2-9260-653d0a7bf100 tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec" returned: 0 in 0.397s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-c1c77acf-3b6b-45c2-9260-653d0a7bf100 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.456s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-c1c77acf-3b6b-45c2-9260-653d0a7bf100 tempest-TaggedBootDevicesTest-959373523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c21375d3-7cf3-4a70-862a-2f8333eee054', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:03:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-c1c77acf-3b6b-45c2-9260-653d0a7bf100 tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:40 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-1ec183c0-5dc6-4b72-8bbb-c1ae9b6a9f28 req-c1c77acf-3b6b-45c2-9260-653d0a7bf100 tempest-TaggedBootDevicesTest-959373523 None] attachment_update completed successfully.
Sep 30 20:03:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-9a7e7043-0af5-431f-b960-301c13a3e29c req-a87baeb2-126c-4a98-a0a1-15534cbf9490 tempest-DeleteServersTestJSON-1979545069 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-9a7e7043-0af5-431f-b960-301c13a3e29c req-a87baeb2-126c-4a98-a0a1-15534cbf9490 tempest-DeleteServersTestJSON-1979545069 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:40 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-9a7e7043-0af5-431f-b960-301c13a3e29c req-a87baeb2-126c-4a98-a0a1-15534cbf9490 tempest-DeleteServersTestJSON-1979545069 None] Terminate volume connection completed successfully.
Sep 30 20:03:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-9a7e7043-0af5-431f-b960-301c13a3e29c req-a87baeb2-126c-4a98-a0a1-15534cbf9490 tempest-DeleteServersTestJSON-1979545069 None] Deleting attachment 23e2f838-6e52-491a-b9d4-50e8789f2de5. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:03:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:03:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Acquiring lock "cinder-471b37d7-6a85-4a8b-abe2-146fda5bf5a6-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:03:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Lock "cinder-471b37d7-6a85-4a8b-abe2-146fda5bf5a6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:03:44 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Acquiring lock "cinder-quobyte-471b37d7-6a85-4a8b-abe2-146fda5bf5a6" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:03:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Lock "cinder-quobyte-471b37d7-6a85-4a8b-abe2-146fda5bf5a6" acquired by "delete_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:03:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb95838b-c202-4374-9a0e-b36d9110563e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6" returned: 0 in 0.157s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-471b37d7-6a85-4a8b-abe2-146fda5bf5a6" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Lock "cinder-quobyte-471b37d7-6a85-4a8b-abe2-146fda5bf5a6" released by "delete_volume" :: held 0.250s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:03:45 devstack cinder-volume[79893]: WARNING cinder.quota [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:03:45 devstack cinder-volume[79893]: WARNING cinder.quota [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Created reservations ['b6b75728-a331-4e97-a88c-269da3a45bf0', '9acbc501-8ebc-4829-a8d6-39bb8c07cf67', 'eaf57de1-55de-4f42-b20b-ffb7ad2d52bf', '59640b52-1dc0-489e-b0df-b7ef6203ba38'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.061s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:03:45 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Deleted volume successfully.
Sep 30 20:03:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c48e354e-6195-4081-b132-bce8d4bf723a tempest-DeleteServersTestJSON-1979545069 None] Lock "cinder-471b37d7-6a85-4a8b-abe2-146fda5bf5a6-delete_volume" released by "delete_volume" :: held 0.554s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:03:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:03:51 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Flow 'volume_create_manager' (29253caf-72b4-47c5-a0a3-f4e8829a0224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1f39b8-f748-4c4c-b9a1-dc629f8048ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1f39b8-f748-4c4c-b9a1-dc629f8048ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-286776081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e79793-d8fd-4466-a894-3ac3953b343a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5058f1087784e419fe6d4d259c92d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:51Z,use_quota=True,user_id='ac9e8f94760e4002ba1d63c45aac9935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971251ed-0720-45d9-9254-7ffc34b714eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971251ed-0720-45d9-9254-7ffc34b714eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6511ff0-d33e-4946-ad49-edd9bb0ba916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6511ff0-d33e-4946-ad49-edd9bb0ba916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e79793-d8fd-4466-a894-3ac3953b343a', 'volume_name': 'volume-11e79793-d8fd-4466-a894-3ac3953b343a', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcb1aea-9214-4601-85ec-debd407677c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dcb1aea-9214-4601-85ec-debd407677c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714b000b-d94e-40f7-a54f-7bb513cfe267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:51 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Volume 11e79793-d8fd-4466-a894-3ac3953b343a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e79793-d8fd-4466-a894-3ac3953b343a', 'volume_size': 1}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-286776081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e79793-d8fd-4466-a894-3ac3953b343a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5058f1087784e419fe6d4d259c92d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:51Z,use_quota=True,user_id='ac9e8f94760e4002ba1d63c45aac9935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Creating volume 11e79793-d8fd-4466-a894-3ac3953b343a {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:03:51 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:51 devstack quobyte-client[79699]: System call "getattr" of process 81729 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:51 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=7, name=volume-11e79793-d8fd-4466-a894-3ac3953b343a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a 1073741824" returned: 0 in 0.156s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a" returned: 0 in 0.030s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] <== create_volume: return (211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.214s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714b000b-d94e-40f7-a54f-7bb513cfe267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e79793-d8fd-4466-a894-3ac3953b343a', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31afd652-90d2-45dd-bc76-e0e97b98998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:51 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Volume volume-11e79793-d8fd-4466-a894-3ac3953b343a (11e79793-d8fd-4466-a894-3ac3953b343a): created successfully
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31afd652-90d2-45dd-bc76-e0e97b98998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Flow 'volume_create_manager' (29253caf-72b4-47c5-a0a3-f4e8829a0224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:51 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-53f4de09-0bc7-48b4-9d10-e8bcfe342979 req-348e6371-898d-4fce-ba8e-ff8764d1171f tempest-VolumesSnapshotsTestJSON-1016598825 None] Created volume successfully.
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.044s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:03:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Creating offline snapshot bcd52362-1e13-443b-ba2d-922d7d1cd092 of volume 11e79793-d8fd-4466-a894-3ac3953b343a {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029af75-5e1c-4e78-97c9-fb2c288c3cbf]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a" returned: 0 in 0.179s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:52 devstack quobyte-client[79699]: System call "lookup" of process 81738 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:52 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=8, name=volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 1G" returned: 0 in 0.089s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): qemu-img rebase -u -b volume-11e79793-d8fd-4466-a894-3ac3953b343a -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:52 devstack quobyte-client[79699]: System call "setlk" of process 81741 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "qemu-img rebase -u -b volume-11e79793-d8fd-4466-a894-3ac3953b343a -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092" returned: 0 in 0.043s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092" returned: 0 in 0.038s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.info" returned: 0 in 0.042s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.info" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.516s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:53 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-8f1bcbd0-21dd-4361-91bb-ecee90d93e74 req-a310593d-9bfc-4002-8b6f-9b13f377a8f9 tempest-VolumesSnapshotsTestJSON-1016598825 None] Create snapshot completed successfully
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "cinder-bcd52362-1e13-443b-ba2d-922d7d1cd092-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-bcd52362-1e13-443b-ba2d-922d7d1cd092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:03:53 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "cinder-quobyte-11e79793-d8fd-4466-a894-3ac3953b343a" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-quobyte-11e79793-d8fd-4466-a894-3ac3953b343a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "cinder-quobyte-bcd52362-1e13-443b-ba2d-922d7d1cd092" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-quobyte-bcd52362-1e13-443b-ba2d-922d7d1cd092" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Deleting offline snapshot bcd52362-1e13-443b-ba2d-922d7d1cd092 of volume 11e79793-d8fd-4466-a894-3ac3953b343a {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] snapshot_file for this snap is: volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[268cfd89-47b8-483c-b64e-6d7b4bc5e4bd]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092" returned: 0 in 0.118s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11e79793-d8fd-4466-a894-3ac3953b343a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f9cffd-3a9d-4cc5-8ddc-b4846cd85cfa]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a" returned: 0 in 0.184s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092" returned: 0 in 0.065s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a.bcd52362-1e13-443b-ba2d-922d7d1cd092" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-quobyte-bcd52362-1e13-443b-ba2d-922d7d1cd092" released by "_delete_snapshot" :: held 0.477s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-quobyte-11e79793-d8fd-4466-a894-3ac3953b343a" released by "delete_snapshot" :: held 0.493s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:03:54 devstack cinder-volume[79893]: WARNING cinder.quota [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG cinder.quota [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Created reservations ['1618e4d7-d9fc-454f-aeed-f43c8c9dd128', '9ce2b067-e8c0-4fc2-b0d6-540b1d283e2b', '35f63f4f-dea1-45c2-8591-9e573b1f6ec0', 'a8c7a0bf-1525-495a-b800-6f46698116e2'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:03:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Delete snapshot completed successfully.
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cfdfff31-4078-40c9-a951-ab2cdcb99e5b req-c23f049f-84a6-49ac-9d42-b81e3af3ec8b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-bcd52362-1e13-443b-ba2d-922d7d1cd092-delete_snapshot" released by "delete_snapshot" :: held 0.615s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "cinder-11e79793-d8fd-4466-a894-3ac3953b343a-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-11e79793-d8fd-4466-a894-3ac3953b343a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:03:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "cinder-quobyte-11e79793-d8fd-4466-a894-3ac3953b343a" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-quobyte-11e79793-d8fd-4466-a894-3ac3953b343a" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[90997246-31a3-41e2-93d2-378eadbdacfe]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a" returned: 0 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11e79793-d8fd-4466-a894-3ac3953b343a" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-quobyte-11e79793-d8fd-4466-a894-3ac3953b343a" released by "delete_volume" :: held 0.188s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG cinder.quota [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Created reservations ['5a98e2d9-3341-4cb7-9caf-dfc65e8248dc', 'c1372d94-fd61-4763-84b9-b65773834948', '570731ee-d285-4e6f-aab7-a269e976c9e0', '1759923d-e2f3-420f-99c2-a86fda71d768'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG cinder.manager [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:03:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Deleted volume successfully.
Sep 30 20:03:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-55f3687f-714c-448e-8942-cca5d4f96b65 req-d2521c9c-22b6-43cb-a942-b653986bb66b tempest-VolumesSnapshotsTestJSON-1016598825 None] Lock "cinder-11e79793-d8fd-4466-a894-3ac3953b343a-delete_volume" released by "delete_volume" :: held 0.361s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:03:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:03:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Flow 'volume_create_manager' (79d00ad4-c554-44c6-80ac-4787550c9332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cd76a8-c462-4104-a6bb-097e155353a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cd76a8-c462-4104-a6bb-097e155353a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1457829769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826957a2-bd2c-42a6-83f6-40fbedd2373b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdc68a4dd9f74f85b6c0cda877b8ca0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:58Z,use_quota=True,user_id='eb8f3d1f08104c6fa8636fc698e72056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53f967f-800a-4c6d-8c8d-b24b92d2aaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53f967f-800a-4c6d-8c8d-b24b92d2aaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ab6ba3-9269-433e-bdf3-a59697a7fa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ab6ba3-9269-433e-bdf3-a59697a7fa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826957a2-bd2c-42a6-83f6-40fbedd2373b', 'volume_name': 'volume-826957a2-bd2c-42a6-83f6-40fbedd2373b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc49b2a-bc5c-4e67-8415-16ee365524cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc49b2a-bc5c-4e67-8415-16ee365524cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572dfa60-5bc8-459b-8276-37da3dd0f768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Volume 826957a2-bd2c-42a6-83f6-40fbedd2373b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826957a2-bd2c-42a6-83f6-40fbedd2373b', 'volume_size': 1}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1457829769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826957a2-bd2c-42a6-83f6-40fbedd2373b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdc68a4dd9f74f85b6c0cda877b8ca0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:58Z,use_quota=True,user_id='eb8f3d1f08104c6fa8636fc698e72056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Creating volume 826957a2-bd2c-42a6-83f6-40fbedd2373b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:03:58 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-826957a2-bd2c-42a6-83f6-40fbedd2373b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:58 devstack quobyte-client[79699]: System call "open" of process 81942 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:58 devstack quobyte-client[79699]: System call "ioctl" of process 81942 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:58 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=10, name=volume-826957a2-bd2c-42a6-83f6-40fbedd2373b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-826957a2-bd2c-42a6-83f6-40fbedd2373b 1073741824" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-826957a2-bd2c-42a6-83f6-40fbedd2373b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-826957a2-bd2c-42a6-83f6-40fbedd2373b" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] <== create_volume: return (167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.169s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572dfa60-5bc8-459b-8276-37da3dd0f768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826957a2-bd2c-42a6-83f6-40fbedd2373b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915354d8-188e-4b77-928d-8a882ee65452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Volume volume-826957a2-bd2c-42a6-83f6-40fbedd2373b (826957a2-bd2c-42a6-83f6-40fbedd2373b): created successfully
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915354d8-188e-4b77-928d-8a882ee65452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Flow 'volume_create_manager' (79d00ad4-c554-44c6-80ac-4787550c9332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1f24bd0a-1871-41fc-8178-16e312c69e59 tempest-VolumesTestJSON-507032091 None] Created volume successfully.
Sep 30 20:03:59 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Flow 'volume_create_manager' (72ccb73f-a9ac-4b3a-ad39-49c2c15a4c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71293d70-edb7-49a4-9b21-b77e55faf2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71293d70-edb7-49a4-9b21-b77e55faf2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1432686428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c32b034-a0fb-4372-b770-ba1f8cf596c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdc68a4dd9f74f85b6c0cda877b8ca0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:59Z,use_quota=True,user_id='eb8f3d1f08104c6fa8636fc698e72056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1261632c-59e2-423d-98f0-752cc7d07bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1261632c-59e2-423d-98f0-752cc7d07bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9334135-3e0c-46d1-92d6-a44ecf95439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9334135-3e0c-46d1-92d6-a44ecf95439f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c32b034-a0fb-4372-b770-ba1f8cf596c0', 'volume_name': 'volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d1658e-758f-4a54-abb4-aebdac26ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d1658e-758f-4a54-abb4-aebdac26ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d71023-0829-4326-af93-6ddcf2f502fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:59 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Volume 3c32b034-a0fb-4372-b770-ba1f8cf596c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0', 'volume_size': 1}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1432686428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c32b034-a0fb-4372-b770-ba1f8cf596c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdc68a4dd9f74f85b6c0cda877b8ca0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:03:59Z,use_quota=True,user_id='eb8f3d1f08104c6fa8636fc698e72056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Creating volume 3c32b034-a0fb-4372-b770-ba1f8cf596c0 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:03:59 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:59 devstack quobyte-client[79699]: System call "getlk" of process 82270 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:03:59 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=11, name=volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0 1073741824" returned: 0 in 0.197s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0" returned: 0 in 0.036s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] <== create_volume: return (246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.249s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d71023-0829-4326-af93-6ddcf2f502fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b9feec-54ef-4b04-b636-dcfa2ad25bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:03:59 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Volume volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0 (3c32b034-a0fb-4372-b770-ba1f8cf596c0): created successfully
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b9feec-54ef-4b04-b636-dcfa2ad25bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:03:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Flow 'volume_create_manager' (72ccb73f-a9ac-4b3a-ad39-49c2c15a4c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:03:59 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-af20f618-5d1b-4eff-95ba-c1a3c9065220 tempest-VolumesTestJSON-507032091 None] Created volume successfully.
Sep 30 20:04:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Flow 'volume_create_manager' (53429711-aa76-41c8-97b3-99e88591f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516cca24-a104-469d-bc69-5b4cc67ff5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516cca24-a104-469d-bc69-5b4cc67ff5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1261808424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5224390f-3ab0-4ab7-8225-69e1125de7d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdc68a4dd9f74f85b6c0cda877b8ca0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:02Z,use_quota=True,user_id='eb8f3d1f08104c6fa8636fc698e72056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d235e9cc-6ecb-4e9c-bf84-fd0a266fa227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d235e9cc-6ecb-4e9c-bf84-fd0a266fa227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f26620f-eb8d-4a52-bfe7-e900f5f67dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f26620f-eb8d-4a52-bfe7-e900f5f67dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5224390f-3ab0-4ab7-8225-69e1125de7d1', 'volume_name': 'volume-5224390f-3ab0-4ab7-8225-69e1125de7d1', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24174d94-a69a-4d41-b3a6-2d1c528d5b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24174d94-a69a-4d41-b3a6-2d1c528d5b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1965e08c-d73b-4bec-8e18-d7c57f5b982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:02 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Volume 5224390f-3ab0-4ab7-8225-69e1125de7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5224390f-3ab0-4ab7-8225-69e1125de7d1', 'volume_size': 1}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1261808424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5224390f-3ab0-4ab7-8225-69e1125de7d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cdc68a4dd9f74f85b6c0cda877b8ca0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:02Z,use_quota=True,user_id='eb8f3d1f08104c6fa8636fc698e72056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Creating volume 5224390f-3ab0-4ab7-8225-69e1125de7d1 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:02 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:04:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-5224390f-3ab0-4ab7-8225-69e1125de7d1 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:02 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=12, name=volume-5224390f-3ab0-4ab7-8225-69e1125de7d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-5224390f-3ab0-4ab7-8225-69e1125de7d1 1073741824" returned: 0 in 0.515s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-5224390f-3ab0-4ab7-8225-69e1125de7d1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-5224390f-3ab0-4ab7-8225-69e1125de7d1" returned: 0 in 0.062s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] <== create_volume: return (644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1965e08c-d73b-4bec-8e18-d7c57f5b982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5224390f-3ab0-4ab7-8225-69e1125de7d1', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3a4b11-109e-48aa-b52f-093ebf0492c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:03 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Volume volume-5224390f-3ab0-4ab7-8225-69e1125de7d1 (5224390f-3ab0-4ab7-8225-69e1125de7d1): created successfully
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3a4b11-109e-48aa-b52f-093ebf0492c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Flow 'volume_create_manager' (53429711-aa76-41c8-97b3-99e88591f670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:03 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-77229cef-e7b0-4be5-b623-93c01488abaa tempest-VolumesTestJSON-507032091 None] Created volume successfully.
Sep 30 20:04:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Acquiring lock "cinder-5224390f-3ab0-4ab7-8225-69e1125de7d1-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Lock "cinder-5224390f-3ab0-4ab7-8225-69e1125de7d1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:05 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Acquiring lock "cinder-quobyte-5224390f-3ab0-4ab7-8225-69e1125de7d1" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Lock "cinder-quobyte-5224390f-3ab0-4ab7-8225-69e1125de7d1" acquired by "delete_volume" :: waited 0.017s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd2e687-bd72-4bd7-8304-3c47b18a8f66]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-5224390f-3ab0-4ab7-8225-69e1125de7d1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:05 devstack quobyte-client[79699]: System call "getattr" of process 82766 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:05 devstack quobyte-client[79699]: System call "lookup" of process 82766 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:05 devstack quobyte-client[79699]: System call "getattr" of process 82766 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:05 devstack quobyte-client[79699]: System call "open" of process 82766 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-5224390f-3ab0-4ab7-8225-69e1125de7d1" returned: 0 in 0.305s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-5224390f-3ab0-4ab7-8225-69e1125de7d1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-5224390f-3ab0-4ab7-8225-69e1125de7d1" returned: 0 in 0.045s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Lock "cinder-quobyte-5224390f-3ab0-4ab7-8225-69e1125de7d1" released by "delete_volume" :: held 0.395s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Created reservations ['9698ba78-36b4-4058-a8e3-8cad05c3c698', '9800ae6d-f953-4b10-b04e-8e0087cab0c5', '07bd3148-17b5-42a7-ba89-3aa999aad433', 'f753fbdd-85cb-4085-a071-d491d0a4b849'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.061s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:05 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Deleted volume successfully.
Sep 30 20:04:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eb0c89a-093e-476a-ba6e-4f2815bb5d78 tempest-VolumesTestJSON-507032091 None] Lock "cinder-5224390f-3ab0-4ab7-8225-69e1125de7d1-delete_volume" released by "delete_volume" :: held 0.768s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Acquiring lock "cinder-3c32b034-a0fb-4372-b770-ba1f8cf596c0-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Lock "cinder-3c32b034-a0fb-4372-b770-ba1f8cf596c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:06 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Acquiring lock "cinder-quobyte-3c32b034-a0fb-4372-b770-ba1f8cf596c0" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Lock "cinder-quobyte-3c32b034-a0fb-4372-b770-ba1f8cf596c0" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4f87f9-4360-41df-b04b-6d5e04e85b0f]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0" returned: 0 in 0.160s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3c32b034-a0fb-4372-b770-ba1f8cf596c0" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Lock "cinder-quobyte-3c32b034-a0fb-4372-b770-ba1f8cf596c0" released by "delete_volume" :: held 0.199s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Created reservations ['cca2f5c6-49ce-4dee-be17-fbace54b1729', '3540910a-5329-462c-8e97-7bbc2b7f331f', 'c198532d-0577-4b92-b8d0-04baac3d8270', '843f9734-681f-4ad5-ad5d-e7999607c9df'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Deleted volume successfully.
Sep 30 20:04:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae5b445-7cbe-4072-bb74-35ad447f5c82 tempest-VolumesTestJSON-507032091 None] Lock "cinder-3c32b034-a0fb-4372-b770-ba1f8cf596c0-delete_volume" released by "delete_volume" :: held 0.374s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Acquiring lock "cinder-826957a2-bd2c-42a6-83f6-40fbedd2373b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Lock "cinder-826957a2-bd2c-42a6-83f6-40fbedd2373b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:07 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Acquiring lock "cinder-quobyte-826957a2-bd2c-42a6-83f6-40fbedd2373b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Lock "cinder-quobyte-826957a2-bd2c-42a6-83f6-40fbedd2373b" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[32232ed6-5f9c-49e6-bbe8-98d4ecf92c7f]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-826957a2-bd2c-42a6-83f6-40fbedd2373b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-826957a2-bd2c-42a6-83f6-40fbedd2373b" returned: 0 in 0.151s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-826957a2-bd2c-42a6-83f6-40fbedd2373b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-826957a2-bd2c-42a6-83f6-40fbedd2373b" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Lock "cinder-quobyte-826957a2-bd2c-42a6-83f6-40fbedd2373b" released by "delete_volume" :: held 0.190s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Created reservations ['22ce544d-c03a-4f88-b7f8-f2f57a5fc3fb', '34e48c4f-7400-4dcb-a5b1-a991b5185969', '0bde53de-d77e-43c1-8d56-b2ca6bf593bd', 'f9e278c9-9bdd-4f3d-90e9-b31a47e85b04'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:07 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Deleted volume successfully.
Sep 30 20:04:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-37467527-4e6b-41b3-9916-aafb7c6f90b4 tempest-VolumesTestJSON-507032091 None] Lock "cinder-826957a2-bd2c-42a6-83f6-40fbedd2373b-delete_volume" released by "delete_volume" :: held 0.364s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:04:17 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=63,cinder:DELETE=4,cinder:SELECT=57,cinder:INSERT=13 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:04:17 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=61,cinder:UPDATE=62,cinder:INSERT=11,cinder:DELETE=7 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:04:18 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Flow 'volume_create_manager' (f227401c-816d-42da-92aa-20146f3ce652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a61f2f4-af7d-430c-937d-a7e50be5c63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a61f2f4-af7d-430c-937d-a7e50be5c63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-80522827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70729594-f7dd-48ac-9aec-fcf297bd6676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cea266fdd364c64bc2d424166272b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:18Z,use_quota=True,user_id='46ec0fdc564e4dd396a4c5b0d373d1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b658000-585d-43ca-9bfa-6f7afe092902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b658000-585d-43ca-9bfa-6f7afe092902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7771302-4640-486e-87c8-438782533829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7771302-4640-486e-87c8-438782533829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70729594-f7dd-48ac-9aec-fcf297bd6676', 'volume_name': 'volume-70729594-f7dd-48ac-9aec-fcf297bd6676', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437a373f-2bba-4ac8-9bf3-5ddfad0029e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (437a373f-2bba-4ac8-9bf3-5ddfad0029e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6d8a75-6112-4b5a-8a74-d04f736733d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:18 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Volume 70729594-f7dd-48ac-9aec-fcf297bd6676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70729594-f7dd-48ac-9aec-fcf297bd6676', 'volume_size': 1}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-80522827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70729594-f7dd-48ac-9aec-fcf297bd6676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cea266fdd364c64bc2d424166272b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:18Z,use_quota=True,user_id='46ec0fdc564e4dd396a4c5b0d373d1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Creating volume 70729594-f7dd-48ac-9aec-fcf297bd6676 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:18 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-70729594-f7dd-48ac-9aec-fcf297bd6676 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:18 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=13, name=volume-70729594-f7dd-48ac-9aec-fcf297bd6676, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-70729594-f7dd-48ac-9aec-fcf297bd6676 1073741824" returned: 0 in 0.140s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-70729594-f7dd-48ac-9aec-fcf297bd6676 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-70729594-f7dd-48ac-9aec-fcf297bd6676" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] <== create_volume: return (166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.168s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6d8a75-6112-4b5a-8a74-d04f736733d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70729594-f7dd-48ac-9aec-fcf297bd6676', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d87c72-7f07-45aa-8f4f-b4d0b28d8bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:18 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Volume volume-70729594-f7dd-48ac-9aec-fcf297bd6676 (70729594-f7dd-48ac-9aec-fcf297bd6676): created successfully
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d87c72-7f07-45aa-8f4f-b4d0b28d8bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Flow 'volume_create_manager' (f227401c-816d-42da-92aa-20146f3ce652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:18 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1822dbf5-8423-4243-b541-bfc933b0e6a8 tempest-VolumesServicesTestJSON-770637969 None] Created volume successfully.
Sep 30 20:04:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Acquiring lock "cinder-70729594-f7dd-48ac-9aec-fcf297bd6676-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Lock "cinder-70729594-f7dd-48ac-9aec-fcf297bd6676-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:19 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Acquiring lock "cinder-quobyte-70729594-f7dd-48ac-9aec-fcf297bd6676" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Lock "cinder-quobyte-70729594-f7dd-48ac-9aec-fcf297bd6676" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcce53ad-f69a-4755-ba48-03e538d64d10]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-70729594-f7dd-48ac-9aec-fcf297bd6676 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-70729594-f7dd-48ac-9aec-fcf297bd6676" returned: 0 in 0.145s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-70729594-f7dd-48ac-9aec-fcf297bd6676 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-70729594-f7dd-48ac-9aec-fcf297bd6676" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Lock "cinder-quobyte-70729594-f7dd-48ac-9aec-fcf297bd6676" released by "delete_volume" :: held 0.199s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Created reservations ['53e65810-0039-47e4-9949-49b11c8d0da8', '82ec9a04-035a-4cd3-8d97-632a3fb65155', '1c05e824-c185-4099-887e-4b86b201d1f1', 'e8cad4de-cdb4-4d68-a1de-36ce0138f267'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:19 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Deleted volume successfully.
Sep 30 20:04:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b0938e48-3f3f-456d-b163-3e36b7ab0bdc tempest-VolumesServicesTestJSON-770637969 None] Lock "cinder-70729594-f7dd-48ac-9aec-fcf297bd6676-delete_volume" released by "delete_volume" :: held 0.337s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:04:26 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Flow 'volume_create_manager' (4d3181b7-ac4e-4c23-b95b-e94b9a5e0232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a063d7fe-781b-4335-aaaf-00834590af02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a063d7fe-781b-4335-aaaf-00834590af02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-615764853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41969aa-4d81-4119-9a59-1ffa0d3133b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b135d377cd4371b5472f7ef20507e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:27Z,use_quota=True,user_id='a757de5841844fe28a688234246aabdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32999d0-e390-4099-85de-67c84fd0e3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c32999d0-e390-4099-85de-67c84fd0e3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a58b8e5-6e66-463a-9eb7-fa92205f907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a58b8e5-6e66-463a-9eb7-fa92205f907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41969aa-4d81-4119-9a59-1ffa0d3133b4', 'volume_name': 'volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef7d0fc-6df3-414c-aa73-b47fa8f0fffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef7d0fc-6df3-414c-aa73-b47fa8f0fffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0237405-edd1-434a-8995-02974e26eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:26 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Volume a41969aa-4d81-4119-9a59-1ffa0d3133b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4', 'volume_size': 1}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-615764853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41969aa-4d81-4119-9a59-1ffa0d3133b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9b135d377cd4371b5472f7ef20507e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:27Z,use_quota=True,user_id='a757de5841844fe28a688234246aabdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Creating volume a41969aa-4d81-4119-9a59-1ffa0d3133b4 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:26 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:26 devstack quobyte-client[79699]: System call "getattr" of process 82862 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:26 devstack quobyte-client[79699]: System call "lookup" of process 82862 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:26 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=14, name=volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 1073741824" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] <== create_volume: return (148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.150s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0237405-edd1-434a-8995-02974e26eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5d048c-9fe2-4d12-aebe-2705c2d10208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:26 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Volume volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 (a41969aa-4d81-4119-9a59-1ffa0d3133b4): created successfully
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5d048c-9fe2-4d12-aebe-2705c2d10208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Flow 'volume_create_manager' (4d3181b7-ac4e-4c23-b95b-e94b9a5e0232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:27 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-25c26364-b723-457b-bc20-6a45439f2f76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Created volume successfully.
Sep 30 20:04:27 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Creating offline snapshot 9e51d37c-540d-4509-b08c-a4f24de2b204 of volume a41969aa-4d81-4119-9a59-1ffa0d3133b4 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:04:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dabf3bc-dbc1-4c2f-9e41-b7e6de0fb6d9]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:28 devstack quobyte-client[79699]: System call "lookup" of process 82866 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:28 devstack quobyte-client[79699]: System call "getattr" of process 82866 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:28 devstack quobyte-client[79699]: System call "open" of process 82866 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4" returned: 0 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:28 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=15, name=volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 1G" returned: 0 in 0.085s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "qemu-img rebase -u -b volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.info" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.info" returned: 0 in 0.015s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.394s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e3b9fac5-698d-43f8-929a-b93903aae3fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Create snapshot completed successfully
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "cinder-9e51d37c-540d-4509-b08c-a4f24de2b204-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-9e51d37c-540d-4509-b08c-a4f24de2b204-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "cinder-quobyte-a41969aa-4d81-4119-9a59-1ffa0d3133b4" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-quobyte-a41969aa-4d81-4119-9a59-1ffa0d3133b4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "cinder-quobyte-9e51d37c-540d-4509-b08c-a4f24de2b204" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-quobyte-9e51d37c-540d-4509-b08c-a4f24de2b204" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Deleting offline snapshot 9e51d37c-540d-4509-b08c-a4f24de2b204 of volume a41969aa-4d81-4119-9a59-1ffa0d3133b4 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] snapshot_file for this snap is: volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[489f069e-803a-41f6-b640-3defe9820d0e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204" returned: 0 in 0.192s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1ddef-0c5a-4182-abe1-73dd0fd37834]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Flow 'volume_create_manager' (80350888-a483-45e5-93e7-54258918a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a06335-9f19-4d9c-bd2c-ec2a0841a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a06335-9f19-4d9c-bd2c-ec2a0841a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1147079939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53019964-12cd-4845-ab42-206e9449cae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e031928448c464aa8c1300fd8a0b3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:30Z,use_quota=True,user_id='eb239653e8144cec821058b53536a0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7480653d-e3b3-4be9-a745-2d43a6e7e9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7480653d-e3b3-4be9-a745-2d43a6e7e9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fec07f3-9116-46fb-9ace-e25890ae26a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fec07f3-9116-46fb-9ace-e25890ae26a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53019964-12cd-4845-ab42-206e9449cae1', 'volume_name': 'volume-53019964-12cd-4845-ab42-206e9449cae1', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d222d9-7682-41f8-9c00-618876b5b54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d222d9-7682-41f8-9c00-618876b5b54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b00c726-48d7-446b-9f64-d6ef0d2cf8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:29 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Volume 53019964-12cd-4845-ab42-206e9449cae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53019964-12cd-4845-ab42-206e9449cae1', 'volume_size': 1}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1147079939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53019964-12cd-4845-ab42-206e9449cae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e031928448c464aa8c1300fd8a0b3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:30Z,use_quota=True,user_id='eb239653e8144cec821058b53536a0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Creating volume 53019964-12cd-4845-ab42-206e9449cae1 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:29 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:29 devstack quobyte-client[79699]: System call "getattr" of process 82888 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4" returned: 0 in 0.212s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:29 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=17, name=volume-53019964-12cd-4845-ab42-206e9449cae1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204" returned: 0 in 0.087s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1 1073741824" returned: 0 in 0.147s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4.9e51d37c-540d-4509-b08c-a4f24de2b204" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] <== create_volume: return (190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.192s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-quobyte-9e51d37c-540d-4509-b08c-a4f24de2b204" released by "_delete_snapshot" :: held 0.597s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b00c726-48d7-446b-9f64-d6ef0d2cf8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53019964-12cd-4845-ab42-206e9449cae1', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18042e08-01d9-4ad3-af99-d5800a6740f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-quobyte-a41969aa-4d81-4119-9a59-1ffa0d3133b4" released by "delete_snapshot" :: held 0.626s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:29 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Volume volume-53019964-12cd-4845-ab42-206e9449cae1 (53019964-12cd-4845-ab42-206e9449cae1): created successfully
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18042e08-01d9-4ad3-af99-d5800a6740f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Flow 'volume_create_manager' (80350888-a483-45e5-93e7-54258918a03a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1baa619d-167a-4a29-afd8-48b8e5a7b2c6 tempest-AttachVolumeTestJSON-143237044 None] Created volume successfully.
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Created reservations ['480bd317-304c-40cd-b8d4-0335b35696c1', '0c0e82cc-26ea-4598-9fe9-ee08421af51c', '422a43c0-1bc2-4312-ac6c-ec3572db39fd', '5f07a8bc-b849-4b42-b1ad-b40403e03a68'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Delete snapshot completed successfully.
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e0c9e91d-00f2-43a2-95f4-2519a0dff20d tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-9e51d37c-540d-4509-b08c-a4f24de2b204-delete_snapshot" released by "delete_snapshot" :: held 0.748s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "cinder-a41969aa-4d81-4119-9a59-1ffa0d3133b4-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-a41969aa-4d81-4119-9a59-1ffa0d3133b4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "cinder-quobyte-a41969aa-4d81-4119-9a59-1ffa0d3133b4" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-quobyte-a41969aa-4d81-4119-9a59-1ffa0d3133b4" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[13183d69-b213-4e9b-a8f8-4df0c508902d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4" returned: 0 in 0.157s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a41969aa-4d81-4119-9a59-1ffa0d3133b4" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-quobyte-a41969aa-4d81-4119-9a59-1ffa0d3133b4" released by "delete_volume" :: held 0.217s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Created reservations ['b6dc2bf8-b0e6-4160-99e6-70126da3a586', 'f92147cf-4e3d-4390-9960-cb7f7a5e44b5', '2a1352fe-2a74-4c41-8ee9-bb8f312d155a', 'ab476199-4b1e-46d3-a54a-97ff0347d360'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.036s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Deleted volume successfully.
Sep 30 20:04:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aca0cbe-701a-4701-9331-aa1e994b95e4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1403983167 None] Lock "cinder-a41969aa-4d81-4119-9a59-1ffa0d3133b4-delete_volume" released by "delete_volume" :: held 0.410s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-4f00160b-cbef-4913-9ff4-9ce23b53c6be req-595c63cd-f1b3-4825-a0dd-f1f64c258db4 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-4f00160b-cbef-4913-9ff4-9ce23b53c6be req-595c63cd-f1b3-4825-a0dd-f1f64c258db4 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:33 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0967a656-8c4e-467a-be60-74d0b276f816]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-4f00160b-cbef-4913-9ff4-9ce23b53c6be req-595c63cd-f1b3-4825-a0dd-f1f64c258db4 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-4f00160b-cbef-4913-9ff4-9ce23b53c6be req-595c63cd-f1b3-4825-a0dd-f1f64c258db4 tempest-AttachVolumeTestJSON-143237044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1" returned: 0 in 0.172s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-4f00160b-cbef-4913-9ff4-9ce23b53c6be req-595c63cd-f1b3-4825-a0dd-f1f64c258db4 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.186s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-4f00160b-cbef-4913-9ff4-9ce23b53c6be req-595c63cd-f1b3-4825-a0dd-f1f64c258db4 tempest-AttachVolumeTestJSON-143237044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-53019964-12cd-4845-ab42-206e9449cae1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82c4bc15-14a7-40e6-975b-1cd56d70ef83', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:04:33 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-4f00160b-cbef-4913-9ff4-9ce23b53c6be req-595c63cd-f1b3-4825-a0dd-f1f64c258db4 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:33 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-4f00160b-cbef-4913-9ff4-9ce23b53c6be req-595c63cd-f1b3-4825-a0dd-f1f64c258db4 tempest-AttachVolumeTestJSON-143237044 None] attachment_update completed successfully.
Sep 30 20:04:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:04:35 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Flow 'volume_create_manager' (bfb85766-15f2-4380-8451-24494b4f324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5aaef47-2435-434e-9f04-81702320f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5aaef47-2435-434e-9f04-81702320f15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1831916222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a17dc25-db9b-42d7-b88c-ef8732f05a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e03492eed945e4960c3de9e27d6a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:35Z,use_quota=True,user_id='04e53a6dd020414f97e5dd7a171f50db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f18a5892-c845-4c90-8702-b06a69ce9a07),volume_type_id=f18a5892-c845-4c90-8702-b06a69ce9a07)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6801e9cf-6a95-417f-9d9d-6e93f5098710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6801e9cf-6a95-417f-9d9d-6e93f5098710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7593a1e9-d26b-404e-acbc-6107e93ce559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7593a1e9-d26b-404e-acbc-6107e93ce559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a17dc25-db9b-42d7-b88c-ef8732f05a67', 'volume_name': 'volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41206ee8-b153-4a30-b6c1-3e7c785b9e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41206ee8-b153-4a30-b6c1-3e7c785b9e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234e78f2-2982-48c9-8e9b-5f337e911038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Volume 2a17dc25-db9b-42d7-b88c-ef8732f05a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67', 'volume_size': 1}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1831916222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a17dc25-db9b-42d7-b88c-ef8732f05a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e03492eed945e4960c3de9e27d6a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:35Z,use_quota=True,user_id='04e53a6dd020414f97e5dd7a171f50db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f18a5892-c845-4c90-8702-b06a69ce9a07),volume_type_id=f18a5892-c845-4c90-8702-b06a69ce9a07)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Creating volume 2a17dc25-db9b-42d7-b88c-ef8732f05a67 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:35 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:35 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=18, name=volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67 1073741824" returned: 0 in 0.124s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] <== create_volume: return (149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.152s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (234e78f2-2982-48c9-8e9b-5f337e911038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d79161c-349d-4745-9f32-aedb0531813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Volume volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67 (2a17dc25-db9b-42d7-b88c-ef8732f05a67): created successfully
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d79161c-349d-4745-9f32-aedb0531813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Flow 'volume_create_manager' (bfb85766-15f2-4380-8451-24494b4f324a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a14d5659-2c03-4a20-9c43-5c230befde52 tempest-VolumeTypesAccessTest-1146037681 None] Created volume successfully.
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Acquiring lock "cinder-2a17dc25-db9b-42d7-b88c-ef8732f05a67-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Lock "cinder-2a17dc25-db9b-42d7-b88c-ef8732f05a67-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:36 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Acquiring lock "cinder-quobyte-2a17dc25-db9b-42d7-b88c-ef8732f05a67" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Lock "cinder-quobyte-2a17dc25-db9b-42d7-b88c-ef8732f05a67" acquired by "delete_volume" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a9d31e-2eb7-48cc-b2b4-a9c53d634ba9]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67" returned: 0 in 0.154s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a17dc25-db9b-42d7-b88c-ef8732f05a67" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Lock "cinder-quobyte-2a17dc25-db9b-42d7-b88c-ef8732f05a67" released by "delete_volume" :: held 0.211s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:36 devstack cinder-volume[79893]: WARNING cinder.quota [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-758484012 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-758484012, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:04:36 devstack cinder-volume[79893]: WARNING cinder.quota [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-758484012 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-758484012, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Created reservations ['e605f9be-7567-4efb-b837-06898a163302', '7c70127a-d3e1-4633-ab18-c34ea14d8e4a', 'cc09d944-ca06-4d2a-8d10-b2c31e43f244', '46d65f3b-f5ea-454e-93ab-48dfa37ced83'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:36 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Deleted volume successfully.
Sep 30 20:04:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-dfa7af7f-6c62-40ee-95cb-f5fe74cbaf80 tempest-VolumeTypesAccessTest-1146037681 None] Lock "cinder-2a17dc25-db9b-42d7-b88c-ef8732f05a67-delete_volume" released by "delete_volume" :: held 0.368s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:04:41 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Flow 'volume_create_manager' (6351e7fb-dad7-4a1c-a0a6-28753e643450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e49516-bee4-4c98-8946-8c29256f9a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2e49516-bee4-4c98-8946-8c29256f9a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1157877895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08475f25-cc32-4580-9a9d-1116c23bad7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470ac8166ecc424db63539b513d29606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:42Z,use_quota=True,user_id='efe8f6650f3142d08a7d3403f3ab8b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a99826-4ff7-4e33-bc89-33ae4115b7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a99826-4ff7-4e33-bc89-33ae4115b7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b331db-a3f8-4121-ab9e-946bdaad6cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b331db-a3f8-4121-ab9e-946bdaad6cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08475f25-cc32-4580-9a9d-1116c23bad7e', 'volume_name': 'volume-08475f25-cc32-4580-9a9d-1116c23bad7e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83900dfd-1c65-4035-8feb-036ebc066c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83900dfd-1c65-4035-8feb-036ebc066c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8b9e96-8edf-4c20-a526-77edac6847de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:41 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Volume 08475f25-cc32-4580-9a9d-1116c23bad7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08475f25-cc32-4580-9a9d-1116c23bad7e', 'volume_size': 1}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1157877895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08475f25-cc32-4580-9a9d-1116c23bad7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470ac8166ecc424db63539b513d29606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:42Z,use_quota=True,user_id='efe8f6650f3142d08a7d3403f3ab8b06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Creating volume 08475f25-cc32-4580-9a9d-1116c23bad7e {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:42 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:42 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=19, name=volume-08475f25-cc32-4580-9a9d-1116c23bad7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:42 devstack quobyte-client[79699]: System call "getattr" of process 82990 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e 1073741824" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] <== create_volume: return (146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.149s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8b9e96-8edf-4c20-a526-77edac6847de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08475f25-cc32-4580-9a9d-1116c23bad7e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6443da-c752-4713-978d-4df953d18442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:42 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Volume volume-08475f25-cc32-4580-9a9d-1116c23bad7e (08475f25-cc32-4580-9a9d-1116c23bad7e): created successfully
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6443da-c752-4713-978d-4df953d18442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Flow 'volume_create_manager' (6351e7fb-dad7-4a1c-a0a6-28753e643450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7716e6d2-1b50-4920-b3af-c3228d15523c tempest-SnapshotMetadataTestJSON-196614547 None] Created volume successfully.
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-9787d198-f135-428d-b128-79827aa27196 req-37212d8f-46c7-4181-a235-a70f4c9e0f6e tempest-VolumesAssistedSnapshotsTest-1927219003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-9787d198-f135-428d-b128-79827aa27196 req-37212d8f-46c7-4181-a235-a70f4c9e0f6e tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7137a0b-778b-4d21-9a80-abfeaff965c8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-9787d198-f135-428d-b128-79827aa27196 req-37212d8f-46c7-4181-a235-a70f4c9e0f6e tempest-VolumesAssistedSnapshotsTest-1927219003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-9787d198-f135-428d-b128-79827aa27196 req-37212d8f-46c7-4181-a235-a70f4c9e0f6e tempest-VolumesAssistedSnapshotsTest-1927219003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57" returned: 0 in 0.172s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-9787d198-f135-428d-b128-79827aa27196 req-37212d8f-46c7-4181-a235-a70f4c9e0f6e tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.189s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.119s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-9787d198-f135-428d-b128-79827aa27196 req-37212d8f-46c7-4181-a235-a70f4c9e0f6e tempest-VolumesAssistedSnapshotsTest-1927219003 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-aeadf12b-81e5-4eab-9d46-d76de414fd57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b254e843-85d0-4d52-88b7-93cb39e7250d', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:04:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-9787d198-f135-428d-b128-79827aa27196 req-37212d8f-46c7-4181-a235-a70f4c9e0f6e tempest-VolumesAssistedSnapshotsTest-1927219003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Creating offline snapshot c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 of volume 08475f25-cc32-4580-9a9d-1116c23bad7e {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[215dd565-5efc-4eb9-a341-faabdb940c9a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-9787d198-f135-428d-b128-79827aa27196 req-37212d8f-46c7-4181-a235-a70f4c9e0f6e tempest-VolumesAssistedSnapshotsTest-1927219003 None] attachment_update completed successfully.
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e" returned: 0 in 0.135s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:43 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=20, name=volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 1G" returned: 0 in 0.104s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): qemu-img rebase -u -b volume-08475f25-cc32-4580-9a9d-1116c23bad7e -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:43 devstack quobyte-client[79699]: System call "getattr" of process 83011 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "qemu-img rebase -u -b volume-08475f25-cc32-4580-9a9d-1116c23bad7e -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" returned: 0 in 0.055s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.info" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.info" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.444s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d5664629-bd28-4d11-9527-38fb2ec3b3d5 tempest-SnapshotMetadataTestJSON-196614547 None] Create snapshot completed successfully
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "cinder-c7578b1a-a0a3-4faf-90e3-beb2f0a38e90-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-c7578b1a-a0a3-4faf-90e3-beb2f0a38e90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:44 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "cinder-quobyte-08475f25-cc32-4580-9a9d-1116c23bad7e" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-quobyte-08475f25-cc32-4580-9a9d-1116c23bad7e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "cinder-quobyte-c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-quobyte-c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Deleting offline snapshot c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 of volume 08475f25-cc32-4580-9a9d-1116c23bad7e {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] snapshot_file for this snap is: volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0306271a-3ebd-46b4-bc9b-bdd5f9971600]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" returned: 0 in 0.270s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08475f25-cc32-4580-9a9d-1116c23bad7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec293880-9943-4c2c-b6d8-78a15854aba8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e" returned: 0 in 0.148s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" returned: 0 in 0.074s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e.c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-quobyte-c7578b1a-a0a3-4faf-90e3-beb2f0a38e90" released by "_delete_snapshot" :: held 0.582s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-quobyte-08475f25-cc32-4580-9a9d-1116c23bad7e" released by "delete_snapshot" :: held 0.604s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Created reservations ['df903265-3e6b-43c2-a320-05c8857b4745', '3066ad44-f192-40ce-9ae7-40d1fe2cba1f', '7477de73-91be-434a-8fb0-075d31d7d3b6', '28f78668-ecf5-496e-8bf1-ca36b3429097'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:45 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Delete snapshot completed successfully.
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2fb3d5a4-9117-4cfe-b4c0-8ed99f84da9f tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-c7578b1a-a0a3-4faf-90e3-beb2f0a38e90-delete_snapshot" released by "delete_snapshot" :: held 0.715s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "cinder-08475f25-cc32-4580-9a9d-1116c23bad7e-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-08475f25-cc32-4580-9a9d-1116c23bad7e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "cinder-quobyte-08475f25-cc32-4580-9a9d-1116c23bad7e" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-quobyte-08475f25-cc32-4580-9a9d-1116c23bad7e" acquired by "delete_volume" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee415f8-bd2e-4a44-b963-4c2184dbce2d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e" returned: 0 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08475f25-cc32-4580-9a9d-1116c23bad7e" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-quobyte-08475f25-cc32-4580-9a9d-1116c23bad7e" released by "delete_volume" :: held 0.196s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Created reservations ['db507953-246e-423a-9a9d-68aaf0b4b18d', 'bfc9bd7a-c4ba-453d-b348-72fc37b3cc3f', '05e59fea-5565-4579-9667-d5c85419776e', '2f7dbfaa-4f78-45c9-b601-97377a95de62'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Deleted volume successfully.
Sep 30 20:04:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1ea2a694-2563-4c3a-868e-6277c05861a7 tempest-SnapshotMetadataTestJSON-196614547 None] Lock "cinder-08475f25-cc32-4580-9a9d-1116c23bad7e-delete_volume" released by "delete_volume" :: held 0.354s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:04:49 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Flow 'volume_create_manager' (b158aec7-5ee6-41b0-ade3-c45845631446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094826c9-0dde-4d32-8ff7-78e91b914869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094826c9-0dde-4d32-8ff7-78e91b914869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2137557333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71edd6ff-bb0d-4ed2-ba85-ae70a124473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040edac7f4645b58dcdec75ff500aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:49Z,use_quota=True,user_id='d3bdc861132f4c2a87f3dca233639ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e133ac93-8e7c-45aa-8882-18e96f41d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e133ac93-8e7c-45aa-8882-18e96f41d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc718b2-e546-4aec-b31a-675831fc9216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc718b2-e546-4aec-b31a-675831fc9216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71edd6ff-bb0d-4ed2-ba85-ae70a124473a', 'volume_name': 'volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17d4a05-11cc-4300-a994-c75cc7324227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17d4a05-11cc-4300-a994-c75cc7324227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40203add-646f-47cf-ba99-475b8319f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:49 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Volume 71edd6ff-bb0d-4ed2-ba85-ae70a124473a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a', 'volume_size': 1}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2137557333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71edd6ff-bb0d-4ed2-ba85-ae70a124473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040edac7f4645b58dcdec75ff500aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:49Z,use_quota=True,user_id='d3bdc861132f4c2a87f3dca233639ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Creating volume 71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:49 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:49 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=22, name=volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:49 devstack quobyte-client[79699]: System call "getattr" of process 83043 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:49 devstack quobyte-client[79699]: System call "open" of process 83043 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a 1073741824" returned: 0 in 0.116s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] <== create_volume: return (139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.141s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40203add-646f-47cf-ba99-475b8319f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477e4090-cc69-4f7b-b39e-472cfa94bdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:49 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Volume volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a (71edd6ff-bb0d-4ed2-ba85-ae70a124473a): created successfully
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477e4090-cc69-4f7b-b39e-472cfa94bdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Flow 'volume_create_manager' (b158aec7-5ee6-41b0-ade3-c45845631446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:49 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-20e4a0b6-b519-4308-bc6b-be9151c5510c tempest-VolumesDeleteCascade-1719319739 None] Created volume successfully.
Sep 30 20:04:50 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Creating offline snapshot c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 of volume 71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3323c32-6aaf-4de2-9d2b-0a4424208b96]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" returned: 0 in 0.152s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:50 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=23, name=volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 1G" returned: 0 in 0.098s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img rebase -u -b volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img rebase -u -b volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.info" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.info" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.429s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:50 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b2d86910-f363-433e-9c35-b38d680c3cd0 tempest-VolumesDeleteCascade-1719319739 None] Create snapshot completed successfully
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:51 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.037s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Creating offline snapshot 8b365088-3210-4b76-9c80-41d8663c6b5b of volume 71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b56959-9e17-4837-92f1-cd6bc038768d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:51 devstack quobyte-client[79699]: System call "getattr" of process 83083 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" returned: 0 in 0.150s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:04:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:51 devstack quobyte-client[79699]: System call "getattr" of process 83087 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:51 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=25, name=volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b 1G" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img rebase -u -b volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img rebase -u -b volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b" returned: 0 in 0.046s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.451s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:52 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-16142379-ed5e-4911-8aa1-a53eeef2b25e tempest-VolumesDeleteCascade-1719319739 None] Create snapshot completed successfully
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-71edd6ff-bb0d-4ed2-ba85-ae70a124473a-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-71edd6ff-bb0d-4ed2-ba85-ae70a124473a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Performing cascade delete. {{(pid=79893) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-8b365088-3210-4b76-9c80-41d8663c6b5b-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-8b365088-3210-4b76-9c80-41d8663c6b5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-8b365088-3210-4b76-9c80-41d8663c6b5b" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-8b365088-3210-4b76-9c80-41d8663c6b5b" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Deleting offline snapshot 8b365088-3210-4b76-9c80-41d8663c6b5b of volume 71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:04:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] snapshot_file for this snap is: volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[40224449-0df0-4a97-a169-c8e43f358042]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b" returned: 0 in 0.388s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[878fc2e3-d438-44bf-a237-be9b266c4bea]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" returned: 0 in 0.186s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b" returned: 0 in 0.210s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.8b365088-3210-4b76-9c80-41d8663c6b5b" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-8b365088-3210-4b76-9c80-41d8663c6b5b" released by "_delete_snapshot" :: held 0.895s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" released by "delete_snapshot" :: held 0.960s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Created reservations ['913e493c-6454-40b8-a207-46b9f6bf3025', 'ac7f3575-1b94-4082-a463-5f429e68094f', '1465299c-00b4-4fb9-92d3-3e6f732598e9', 'dcd2b49d-75ee-41f2-9ea8-3e2cca876743'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:53 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Delete snapshot completed successfully.
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-8b365088-3210-4b76-9c80-41d8663c6b5b-delete_snapshot" released by "delete_snapshot" :: held 1.097s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:53 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" acquired by "delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Deleting offline snapshot c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 of volume 71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] snapshot_file for this snap is: volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec24bbf-cc02-483a-a740-5ad9fc130d31]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:54 devstack quobyte-client[79699]: System call "open" of process 83180 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" returned: 0 in 0.170s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6590fe0-a483-4dfe-b5b9-1c0161f82d2e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" returned: 0 in 0.155s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" returned: 0 in 0.076s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a.c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5" released by "_delete_snapshot" :: held 0.488s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" released by "delete_snapshot" :: held 0.500s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Created reservations ['ce855781-d711-4eb5-a9f8-ffdb3d120d46', 'f27af91f-e08f-42b0-92da-9432f6bde0b3', '2ca1454e-dcb6-4a16-8c60-f0c7b47d0289', '3e42930f-74ea-4bc1-840d-c2f26811a90f'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Delete snapshot completed successfully.
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-c3de6b2c-17b8-4b8b-b2fa-0c9fd1bbf5e5-delete_snapshot" released by "delete_snapshot" :: held 0.604s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Snapshots deleted, issuing volume delete {{(pid=79893) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef78f202-f0ad-40c6-b433-063a4df154d4]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" returned: 0 in 0.167s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-71edd6ff-bb0d-4ed2-ba85-ae70a124473a" released by "delete_volume" :: held 0.226s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Created reservations ['e504b311-f636-4fa7-afd8-65154379c13b', 'ce9c8df6-b67d-4e2a-8831-d239aa414d0d', '390d33d3-84a5-4692-9116-24f7951abcb9', 'a1341f3a-0b34-4ea9-91ec-c5aaaa3cd2f0'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.045s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:04:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Deleted volume successfully.
Sep 30 20:04:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-aeb7ca52-30ee-4a43-a411-650bb4f56728 tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-71edd6ff-bb0d-4ed2-ba85-ae70a124473a-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:04:55 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Flow 'volume_create_manager' (b3f6c404-9bb3-4516-a67d-514e4e7b30d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6194914-7637-46fe-9e9f-da1c555a862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6194914-7637-46fe-9e9f-da1c555a862f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2038120135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ca6411-e60d-46ed-aec4-f9207b2af207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040edac7f4645b58dcdec75ff500aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:55Z,use_quota=True,user_id='d3bdc861132f4c2a87f3dca233639ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bc7edc-6c4c-46cb-9b9f-2dfd18231e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bc7edc-6c4c-46cb-9b9f-2dfd18231e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3234f6f-7d05-4fc9-b9c2-3eb4a841f924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3234f6f-7d05-4fc9-b9c2-3eb4a841f924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ca6411-e60d-46ed-aec4-f9207b2af207', 'volume_name': 'volume-f9ca6411-e60d-46ed-aec4-f9207b2af207', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d1db22-b4d4-401a-b945-43ff72450259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d1db22-b4d4-401a-b945-43ff72450259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ab193f-82ac-433e-b42d-716148ce371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:55 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Volume f9ca6411-e60d-46ed-aec4-f9207b2af207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ca6411-e60d-46ed-aec4-f9207b2af207', 'volume_size': 1}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2038120135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ca6411-e60d-46ed-aec4-f9207b2af207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040edac7f4645b58dcdec75ff500aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:55Z,use_quota=True,user_id='d3bdc861132f4c2a87f3dca233639ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Creating volume f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:55 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:55 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=26, name=volume-f9ca6411-e60d-46ed-aec4-f9207b2af207, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 1073741824" returned: 0 in 0.130s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207" returned: 0 in 0.039s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] <== create_volume: return (178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.180s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ab193f-82ac-433e-b42d-716148ce371c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ca6411-e60d-46ed-aec4-f9207b2af207', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b848b6-8384-4e79-bf85-4b2c0a69ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:55 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Volume volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 (f9ca6411-e60d-46ed-aec4-f9207b2af207): created successfully
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06b848b6-8384-4e79-bf85-4b2c0a69ae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Flow 'volume_create_manager' (b3f6c404-9bb3-4516-a67d-514e4e7b30d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-cd2b5c29-3760-43b0-b919-91ee2b0a8c86 tempest-VolumesDeleteCascade-1719319739 None] Created volume successfully.
Sep 30 20:04:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:04:56 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Creating offline snapshot 193097a2-5c04-41c7-a06e-d973e88e9800 of volume f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ea566-1029-4616-8ee3-5c165ebc1844]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:56 devstack quobyte-client[79699]: System call "lookup" of process 83204 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:04:56 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=27, name=volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 1G" returned: 0 in 0.105s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img rebase -u -b volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img rebase -u -b volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800" returned: 0 in 0.044s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.info" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.info" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.415s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f7d989d3-6242-4100-bd51-912ad190e78c tempest-VolumesDeleteCascade-1719319739 None] Create snapshot completed successfully
Sep 30 20:04:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Flow 'volume_create_manager' (1f689741-43f6-4f3e-8d91-f9877848c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996bc525-d5a7-44c0-80e4-cccc3e443deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996bc525-d5a7-44c0-80e4-cccc3e443deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1032392088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a70821-c610-4080-acac-459edd250d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f040edac7f4645b58dcdec75ff500aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=193097a2-5c04-41c7-a06e-d973e88e9800,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:04:58Z,use_quota=True,user_id='d3bdc861132f4c2a87f3dca233639ef9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15241c53-379f-4470-9004-79e90e240fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15241c53-379f-4470-9004-79e90e240fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0788182-08bd-4084-918e-45934c559cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0788182-08bd-4084-918e-45934c559cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09a70821-c610-4080-acac-459edd250d4a', 'volume_name': 'volume-09a70821-c610-4080-acac-459edd250d4a', 'volume_size': 1, 'snapshot_id': '193097a2-5c04-41c7-a06e-d973e88e9800'}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925fb2f4-4638-44c8-ae55-7bf19314643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925fb2f4-4638-44c8-ae55-7bf19314643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39fa77f1-ad86-4c7c-8412-fc219f1b34fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:04:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Volume 09a70821-c610-4080-acac-459edd250d4a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09a70821-c610-4080-acac-459edd250d4a', 'volume_size': 1, 'snapshot_id': '193097a2-5c04-41c7-a06e-d973e88e9800'}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-193097a2-5c04-41c7-a06e-d973e88e9800-09a70821-c610-4080-acac-459edd250d4a" by "_create_volume_from_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-193097a2-5c04-41c7-a06e-d973e88e9800-09a70821-c610-4080-acac-459edd250d4a" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Creating volume 09a70821-c610-4080-acac-459edd250d4a from snapshot 193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-09a70821-c610-4080-acac-459edd250d4a" by "_copy_volume_from_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-09a70821-c610-4080-acac-459edd250d4a" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] snapshot: 193097a2-5c04-41c7-a06e-d973e88e9800, volume: 09a70821-c610-4080-acac-459edd250d4a,  {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e11eca-078c-497d-b344-4e81c9792ab2]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800" returned: 0 in 0.130s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ca6411-e60d-46ed-aec4-f9207b2af207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Creating direct copy from snapshot {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c369d244-3b69-484b-b5ca-da60e1b22dc7]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207" returned: 0 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG cinder.utils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a not found in is_blk_device check {{(pid=79893) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 30 20:04:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:04:58 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=29, name=volume-09a70821-c610-4080-acac-459edd250d4a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a" returned: 0 in 1.920s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20253cd-c68b-483c-a862-81cf23518fc0]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207" returned: 0 in 0.261s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:05:00 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Converted 1024.00 MB image at 533.03 MB/s
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-09a70821-c610-4080-acac-459edd250d4a" released by "_copy_volume_from_snapshot" :: held 2.524s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-193097a2-5c04-41c7-a06e-d973e88e9800-09a70821-c610-4080-acac-459edd250d4a" released by "_create_volume_from_snapshot" :: held 2.540s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.550s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39fa77f1-ad86-4c7c-8412-fc219f1b34fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a70821-c610-4080-acac-459edd250d4a', 'volume_size': 1, 'snapshot_id': '193097a2-5c04-41c7-a06e-d973e88e9800'}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d713285a-00f6-4582-a5fa-a218f84acaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:00 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Volume volume-09a70821-c610-4080-acac-459edd250d4a (09a70821-c610-4080-acac-459edd250d4a): created successfully
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d713285a-00f6-4582-a5fa-a218f84acaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Flow 'volume_create_manager' (1f689741-43f6-4f3e-8d91-f9877848c16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:00 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1568ce4d-50d1-44c8-8f2b-7a31e8225cdb tempest-VolumesDeleteCascade-1719319739 None] Created volume successfully.
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-f9ca6411-e60d-46ed-aec4-f9207b2af207-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-f9ca6411-e60d-46ed-aec4-f9207b2af207-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:01 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Performing cascade delete. {{(pid=79893) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-193097a2-5c04-41c7-a06e-d973e88e9800-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-193097a2-5c04-41c7-a06e-d973e88e9800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:01 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-f9ca6411-e60d-46ed-aec4-f9207b2af207" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-f9ca6411-e60d-46ed-aec4-f9207b2af207" acquired by "delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-193097a2-5c04-41c7-a06e-d973e88e9800" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-193097a2-5c04-41c7-a06e-d973e88e9800" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Deleting offline snapshot 193097a2-5c04-41c7-a06e-d973e88e9800 of volume f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] snapshot_file for this snap is: volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c18648-1960-41df-9fb3-a5b7b936c458]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800" returned: 0 in 0.141s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ca6411-e60d-46ed-aec4-f9207b2af207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[30311d7e-8d7f-4ec4-9fd0-4ef1e0474c7a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800" returned: 0 in 0.077s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207.193097a2-5c04-41c7-a06e-d973e88e9800" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-193097a2-5c04-41c7-a06e-d973e88e9800" released by "_delete_snapshot" :: held 0.424s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-f9ca6411-e60d-46ed-aec4-f9207b2af207" released by "delete_snapshot" :: held 0.433s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Created reservations ['33bd7d70-9ec2-42d0-a32b-166744a45712', '5781c3e8-09fd-461e-bbf8-a1c3b57be37a', 'aedb29ec-153c-4a0f-ab9a-b82505ed19b7', '0fb1d00f-7155-4188-9060-3cde1f48df9d'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:02 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Delete snapshot completed successfully.
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-193097a2-5c04-41c7-a06e-d973e88e9800-delete_snapshot" released by "delete_snapshot" :: held 0.544s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Snapshots deleted, issuing volume delete {{(pid=79893) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-f9ca6411-e60d-46ed-aec4-f9207b2af207" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-f9ca6411-e60d-46ed-aec4-f9207b2af207" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1ce1e5-0de4-4f5b-8acf-20cf60367eaf]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:02 devstack quobyte-client[79699]: System call "lookup" of process 83270 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:02 devstack quobyte-client[79699]: System call "getattr" of process 83270 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:02 devstack quobyte-client[79699]: System call "open" of process 83270 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207" returned: 0 in 0.154s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f9ca6411-e60d-46ed-aec4-f9207b2af207" returned: 0 in 0.044s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-f9ca6411-e60d-46ed-aec4-f9207b2af207" released by "delete_volume" :: held 0.233s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Created reservations ['c77f7c2a-0f23-46b4-84a8-509ac6074637', 'e2ff4949-edab-4cb2-a520-232100defa15', 'e290cc87-2165-43a6-ac2c-78ab5fe700d6', '65db71a9-829e-4495-8c19-190ed0060011'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:02 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Deleted volume successfully.
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-33b08b28-62e9-42f5-9cf9-84c45a40ef8e tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-f9ca6411-e60d-46ed-aec4-f9207b2af207-delete_volume" released by "delete_volume" :: held 0.979s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-09a70821-c610-4080-acac-459edd250d4a-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-09a70821-c610-4080-acac-459edd250d4a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "cinder-quobyte-09a70821-c610-4080-acac-459edd250d4a" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-09a70821-c610-4080-acac-459edd250d4a" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c27d813-6afe-4ee9-83d1-739e875949b3]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a" returned: 0 in 0.203s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-09a70821-c610-4080-acac-459edd250d4a" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-quobyte-09a70821-c610-4080-acac-459edd250d4a" released by "delete_volume" :: held 0.262s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Created reservations ['ecda6485-7d30-435b-a761-1f0d666dc353', '2dc50b60-65be-4e73-9246-f7143c05390e', '7f0c5ced-8f1e-4491-835d-ca3eea26dba9', '97971d63-235b-47b9-b4d0-3bf696e3cbea'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:03 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Deleted volume successfully.
Sep 30 20:05:03 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9994a47a-e24b-45f3-bb7d-c1ca4eeb74ef tempest-VolumesDeleteCascade-1719319739 None] Lock "cinder-09a70821-c610-4080-acac-459edd250d4a-delete_volume" released by "delete_volume" :: held 0.444s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:05:05 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Flow 'volume_create_manager' (4d2dcb1e-8e98-4e5a-9222-988aef34d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadb322c-b0a3-44d4-a571-72a2a7bfa21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eadb322c-b0a3-44d4-a571-72a2a7bfa21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1019682152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a7e4f7-43a1-4577-b6a2-7f6368abbc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79edcbf7220c4ff9b5424d663100c727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:06Z,use_quota=True,user_id='18d15fdb5fef4f0b9e419e739eb65580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0b9a3d-6b3b-4fbc-b1af-e74653a8692c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0b9a3d-6b3b-4fbc-b1af-e74653a8692c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd554928-6025-4e5a-b9b4-03e514a5ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd554928-6025-4e5a-b9b4-03e514a5ac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a7e4f7-43a1-4577-b6a2-7f6368abbc60', 'volume_name': 'volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67cacab-f941-40a6-b7fa-f9ca944b9423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67cacab-f941-40a6-b7fa-f9ca944b9423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2ea244-0b63-4d7b-86cd-bc50207bcf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:05 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Volume 95a7e4f7-43a1-4577-b6a2-7f6368abbc60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60', 'volume_size': 1}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1019682152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a7e4f7-43a1-4577-b6a2-7f6368abbc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79edcbf7220c4ff9b5424d663100c727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:06Z,use_quota=True,user_id='18d15fdb5fef4f0b9e419e739eb65580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Creating volume 95a7e4f7-43a1-4577-b6a2-7f6368abbc60 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:05:05 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:05:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:05 devstack quobyte-client[79699]: System call "lookup" of process 83319 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:05 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=30, name=volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60 1073741824" returned: 0 in 0.182s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] <== create_volume: return (231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.234s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2ea244-0b63-4d7b-86cd-bc50207bcf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9497d712-7ac9-4173-8f58-a31a81d1d8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:06 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Volume volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60 (95a7e4f7-43a1-4577-b6a2-7f6368abbc60): created successfully
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9497d712-7ac9-4173-8f58-a31a81d1d8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:06 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Flow 'volume_create_manager' (4d2dcb1e-8e98-4e5a-9222-988aef34d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c0c93a9f-5ace-4abb-983f-bbe4028a737e tempest-VolumesMetadataTest-1636302316 None] Created volume successfully.
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Acquiring lock "cinder-95a7e4f7-43a1-4577-b6a2-7f6368abbc60-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Lock "cinder-95a7e4f7-43a1-4577-b6a2-7f6368abbc60-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:07 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Acquiring lock "cinder-quobyte-95a7e4f7-43a1-4577-b6a2-7f6368abbc60" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Lock "cinder-quobyte-95a7e4f7-43a1-4577-b6a2-7f6368abbc60" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b22e40a-93f3-4cf5-afde-062fbc69358e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95a7e4f7-43a1-4577-b6a2-7f6368abbc60" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Lock "cinder-quobyte-95a7e4f7-43a1-4577-b6a2-7f6368abbc60" released by "delete_volume" :: held 0.191s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Created reservations ['983ef3e7-06a5-45c4-89c6-d29325fbe15a', 'e56db8eb-8c2d-405c-98a9-32c46999afd0', '715ac7ad-e6ff-495c-9cdc-09c1aef342a2', '7b7caf9c-4198-42a8-8277-9849d20ef547'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:07 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Deleted volume successfully.
Sep 30 20:05:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-131cebc7-2b3e-42ba-8a22-e4184d0dadc7 tempest-VolumesMetadataTest-1636302316 None] Lock "cinder-95a7e4f7-43a1-4577-b6a2-7f6368abbc60-delete_volume" released by "delete_volume" :: held 0.355s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:11 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Flow 'volume_create_manager' (9ba1cd0c-c994-49fd-9fe5-879ee9a2588f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9d6999-ca4c-47bc-9d45-bba4bbf84627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9d6999-ca4c-47bc-9d45-bba4bbf84627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1896900889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cacad7e-5834-4455-9851-a6c0c69202d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c52c413a37e49e2ba60f457f8d65cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:11Z,use_quota=True,user_id='2b0f7447ba74404f8b55cb4ecbc7da52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a063e0-9e0b-4716-a03a-cc812cc0276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a063e0-9e0b-4716-a03a-cc812cc0276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54df66e7-3811-4926-a4f6-269b70b16d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54df66e7-3811-4926-a4f6-269b70b16d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cacad7e-5834-4455-9851-a6c0c69202d0', 'volume_name': 'volume-6cacad7e-5834-4455-9851-a6c0c69202d0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd746a33-1697-452b-8ab9-0ce3b82b37bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd746a33-1697-452b-8ab9-0ce3b82b37bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd3bb3e-8904-48ff-9062-47d1ccf34377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:11 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Volume 6cacad7e-5834-4455-9851-a6c0c69202d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cacad7e-5834-4455-9851-a6c0c69202d0', 'volume_size': 1}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1896900889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cacad7e-5834-4455-9851-a6c0c69202d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c52c413a37e49e2ba60f457f8d65cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:11Z,use_quota=True,user_id='2b0f7447ba74404f8b55cb4ecbc7da52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Creating volume 6cacad7e-5834-4455-9851-a6c0c69202d0 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:05:11 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6cacad7e-5834-4455-9851-a6c0c69202d0 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:11 devstack quobyte-client[79699]: System call "getattr" of process 83329 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:11 devstack quobyte-client[79699]: System call "lookup" of process 83329 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:11 devstack quobyte-client[79699]: System call "getattr" of process 83329 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:11 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=31, name=volume-6cacad7e-5834-4455-9851-a6c0c69202d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:05:11 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-ae4be472-be9c-43d2-884e-a303dc724aea req-ebb88dbb-ac48-4116-a569-9fc14db20f69 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:11 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-ae4be472-be9c-43d2-884e-a303dc724aea req-ebb88dbb-ac48-4116-a569-9fc14db20f69 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:11 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-ae4be472-be9c-43d2-884e-a303dc724aea req-ebb88dbb-ac48-4116-a569-9fc14db20f69 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Terminate volume connection completed successfully.
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-ae4be472-be9c-43d2-884e-a303dc724aea req-ebb88dbb-ac48-4116-a569-9fc14db20f69 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Deleting attachment b254e843-85d0-4d52-88b7-93cb39e7250d. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6cacad7e-5834-4455-9851-a6c0c69202d0 1073741824" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6cacad7e-5834-4455-9851-a6c0c69202d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6cacad7e-5834-4455-9851-a6c0c69202d0" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] <== create_volume: return (167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.169s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd3bb3e-8904-48ff-9062-47d1ccf34377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cacad7e-5834-4455-9851-a6c0c69202d0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6372dae5-baed-421c-9d64-c39d4db27029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:11 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Volume volume-6cacad7e-5834-4455-9851-a6c0c69202d0 (6cacad7e-5834-4455-9851-a6c0c69202d0): created successfully
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6372dae5-baed-421c-9d64-c39d4db27029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Flow 'volume_create_manager' (9ba1cd0c-c994-49fd-9fe5-879ee9a2588f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:11 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6e300674-c65a-422c-952d-854e8b7e4c41 tempest-VolumesTransfersTest-819662505 None] Created volume successfully.
Sep 30 20:05:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:05:12 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1df44331-0e73-4d28-8faa-680afe025786 tempest-VolumesTransfersTest-389312878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:12 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1df44331-0e73-4d28-8faa-680afe025786 tempest-VolumesTransfersTest-389312878 None] Transfer volume completed successfully.
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Acquiring lock "cinder-aeadf12b-81e5-4eab-9d46-d76de414fd57-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "cinder-aeadf12b-81e5-4eab-9d46-d76de414fd57-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:13 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Acquiring lock "cinder-quobyte-aeadf12b-81e5-4eab-9d46-d76de414fd57" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "cinder-quobyte-aeadf12b-81e5-4eab-9d46-d76de414fd57" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f55e3-e079-4bae-b132-af46422c0a4a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57" returned: 0 in 0.163s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Acquiring lock "cinder-6cacad7e-5834-4455-9851-a6c0c69202d0-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-aeadf12b-81e5-4eab-9d46-d76de414fd57" returned: 0 in 0.042s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "cinder-quobyte-aeadf12b-81e5-4eab-9d46-d76de414fd57" released by "delete_volume" :: held 0.236s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Lock "cinder-6cacad7e-5834-4455-9851-a6c0c69202d0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:13 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Acquiring lock "cinder-quobyte-6cacad7e-5834-4455-9851-a6c0c69202d0" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Created reservations ['1c3491a7-a870-4489-9898-43c55c528138', 'f0bdefeb-d34f-4ac2-9e1b-30a715fe2d7c', '86ff4fab-ff54-41af-acb8-d2186ee228b0', '058f06fc-c748-4d12-8d9f-a74eb9532a62'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Lock "cinder-quobyte-6cacad7e-5834-4455-9851-a6c0c69202d0" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca7a00c-cccd-4e96-8635-459f02455858]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6cacad7e-5834-4455-9851-a6c0c69202d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:13 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Deleted volume successfully.
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-593965c5-ce7e-4c7c-abca-bcf34895b194 tempest-VolumesAssistedSnapshotsTest-1927219003 None] Lock "cinder-aeadf12b-81e5-4eab-9d46-d76de414fd57-delete_volume" released by "delete_volume" :: held 0.472s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6cacad7e-5834-4455-9851-a6c0c69202d0" returned: 0 in 0.176s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6cacad7e-5834-4455-9851-a6c0c69202d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6cacad7e-5834-4455-9851-a6c0c69202d0" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Lock "cinder-quobyte-6cacad7e-5834-4455-9851-a6c0c69202d0" released by "delete_volume" :: held 0.216s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Created reservations ['fe120125-16ca-488e-a8c4-22cce171e96e', 'dec1958a-6189-4b05-bd77-ba4831c13fa5', '44d519d6-09a4-4bcf-9cf9-5178708a2980', 'd129b86f-9170-4123-b2e3-c7a241c3cc33'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:13 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Deleted volume successfully.
Sep 30 20:05:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96ce0058-ba4b-4204-9ad3-3d8585252f8d tempest-VolumesTransfersTest-1808035078 None] Lock "cinder-6cacad7e-5834-4455-9851-a6c0c69202d0-delete_volume" released by "delete_volume" :: held 0.389s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:15 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Flow 'volume_create_manager' (9443a42b-7724-4cb8-8a25-e3394c367eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df5d494-5d14-4724-a7a7-1394c9b6da7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df5d494-5d14-4724-a7a7-1394c9b6da7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1824950839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53c97b5-bcfc-4542-8309-4cc8e8464b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c52c413a37e49e2ba60f457f8d65cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:15Z,use_quota=True,user_id='2b0f7447ba74404f8b55cb4ecbc7da52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190d15dd-3db1-4806-a8a7-73141b4533b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190d15dd-3db1-4806-a8a7-73141b4533b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2cc06e-07fb-4893-854f-7d2cf924c631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2cc06e-07fb-4893-854f-7d2cf924c631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a53c97b5-bcfc-4542-8309-4cc8e8464b8b', 'volume_name': 'volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd431f2-b842-4760-a945-eb1f51de65da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd431f2-b842-4760-a945-eb1f51de65da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62dac5ba-99d1-4a1d-b056-fbc75bc5330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:15 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Volume a53c97b5-bcfc-4542-8309-4cc8e8464b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b', 'volume_size': 1}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1824950839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53c97b5-bcfc-4542-8309-4cc8e8464b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c52c413a37e49e2ba60f457f8d65cf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:15Z,use_quota=True,user_id='2b0f7447ba74404f8b55cb4ecbc7da52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Creating volume a53c97b5-bcfc-4542-8309-4cc8e8464b8b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:05:15 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:15 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=32, name=volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b 1073741824" returned: 0 in 0.136s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] <== create_volume: return (174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.177s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62dac5ba-99d1-4a1d-b056-fbc75bc5330d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db41dd3e-b2c0-4651-9e24-19ffa5f0a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:15 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Volume volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b (a53c97b5-bcfc-4542-8309-4cc8e8464b8b): created successfully
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db41dd3e-b2c0-4651-9e24-19ffa5f0a01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Flow 'volume_create_manager' (9443a42b-7724-4cb8-8a25-e3394c367eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:15 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a3d5691c-6f52-4a4b-899c-90cbbc559747 tempest-VolumesTransfersTest-819662505 None] Created volume successfully.
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Acquiring lock "cinder-a53c97b5-bcfc-4542-8309-4cc8e8464b8b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Lock "cinder-a53c97b5-bcfc-4542-8309-4cc8e8464b8b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:16 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Acquiring lock "cinder-quobyte-a53c97b5-bcfc-4542-8309-4cc8e8464b8b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Lock "cinder-quobyte-a53c97b5-bcfc-4542-8309-4cc8e8464b8b" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c049263-e78a-4933-a442-f6b5a40609ae]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b" returned: 0 in 0.234s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a53c97b5-bcfc-4542-8309-4cc8e8464b8b" returned: 0 in 0.039s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Lock "cinder-quobyte-a53c97b5-bcfc-4542-8309-4cc8e8464b8b" released by "delete_volume" :: held 0.295s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Created reservations ['c37ca88a-6cfe-4b25-adde-480b07186339', '183aebdb-ee32-4c0a-86fb-0e84f5311cfc', 'fee02be4-2e9e-4d47-8484-c1df893d2af3', 'b87c13b5-696a-418b-98fe-eefab45b9ea0'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:16 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Deleted volume successfully.
Sep 30 20:05:16 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-336c9ac1-edde-4ed6-9726-23f0bffae853 tempest-VolumesTransfersTest-1808035078 None] Lock "cinder-a53c97b5-bcfc-4542-8309-4cc8e8464b8b-delete_volume" released by "delete_volume" :: held 0.462s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=119,cinder:INSERT=33,cinder:UPDATE=126,cinder:DELETE=15 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=167,cinder:DELETE=12,cinder:SELECT=108,cinder:INSERT=31 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:05:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Flow 'volume_create_manager' (a0b6ede3-5656-40a4-9335-b4a79d1e4f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc86f678-6f87-49fd-9f40-b290904839cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc86f678-6f87-49fd-9f40-b290904839cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1591812793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211e86d2-a1ad-4230-b704-9b0f026d83e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0a0e900c084b798b74a65cfde66c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:24Z,use_quota=True,user_id='fdfa6c76fd7a431b9506c99c88a200d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2023117c-d699-4497-ba26-2553ac56e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2023117c-d699-4497-ba26-2553ac56e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26347182-9b78-40bd-bd82-d984c0ec5b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26347182-9b78-40bd-bd82-d984c0ec5b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211e86d2-a1ad-4230-b704-9b0f026d83e0', 'volume_name': 'volume-211e86d2-a1ad-4230-b704-9b0f026d83e0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3f018b-a6b8-422b-889e-fd3bff2609ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3f018b-a6b8-422b-889e-fd3bff2609ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a5fa1f-24dc-4a6d-833f-72f875ebbd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:24 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Volume 211e86d2-a1ad-4230-b704-9b0f026d83e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211e86d2-a1ad-4230-b704-9b0f026d83e0', 'volume_size': 1}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1591812793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211e86d2-a1ad-4230-b704-9b0f026d83e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0a0e900c084b798b74a65cfde66c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:24Z,use_quota=True,user_id='fdfa6c76fd7a431b9506c99c88a200d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Creating volume 211e86d2-a1ad-4230-b704-9b0f026d83e0 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:05:24 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-211e86d2-a1ad-4230-b704-9b0f026d83e0 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:24 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=33, name=volume-211e86d2-a1ad-4230-b704-9b0f026d83e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-211e86d2-a1ad-4230-b704-9b0f026d83e0 1073741824" returned: 0 in 0.153s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-211e86d2-a1ad-4230-b704-9b0f026d83e0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-211e86d2-a1ad-4230-b704-9b0f026d83e0" returned: 0 in 0.043s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] <== create_volume: return (207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.209s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a5fa1f-24dc-4a6d-833f-72f875ebbd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211e86d2-a1ad-4230-b704-9b0f026d83e0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eff735b-2f97-459f-b75d-26f593f72c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:24 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Volume volume-211e86d2-a1ad-4230-b704-9b0f026d83e0 (211e86d2-a1ad-4230-b704-9b0f026d83e0): created successfully
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eff735b-2f97-459f-b75d-26f593f72c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Flow 'volume_create_manager' (a0b6ede3-5656-40a4-9335-b4a79d1e4f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:24 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8e7e6510-a27f-4f4d-9015-27a745404e30 tempest-VolumesTransfersV355Test-162962574 None] Created volume successfully.
Sep 30 20:05:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-42b11f2d-5a30-49a0-ace1-0bceee6dffd2 tempest-VolumesTransfersV355Test-1992895202 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-42b11f2d-5a30-49a0-ace1-0bceee6dffd2 tempest-VolumesTransfersV355Test-1992895202 None] Transfer volume completed successfully.
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Acquiring lock "cinder-211e86d2-a1ad-4230-b704-9b0f026d83e0-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Lock "cinder-211e86d2-a1ad-4230-b704-9b0f026d83e0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:26 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Acquiring lock "cinder-quobyte-211e86d2-a1ad-4230-b704-9b0f026d83e0" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Lock "cinder-quobyte-211e86d2-a1ad-4230-b704-9b0f026d83e0" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[39231294-e9b5-4919-849f-f8b301cc4d0c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-211e86d2-a1ad-4230-b704-9b0f026d83e0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-211e86d2-a1ad-4230-b704-9b0f026d83e0" returned: 0 in 0.196s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-211e86d2-a1ad-4230-b704-9b0f026d83e0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-211e86d2-a1ad-4230-b704-9b0f026d83e0" returned: 0 in 0.026s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Lock "cinder-quobyte-211e86d2-a1ad-4230-b704-9b0f026d83e0" released by "delete_volume" :: held 0.247s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Created reservations ['65522b62-71c1-40e7-b051-721a5f48333b', '964500f0-6e84-42d4-b517-603aca517126', '9927a343-f393-4f59-b271-017d8e6d468d', '490d9c75-6094-42c3-8164-25cf0dbc68e6'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:26 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Deleted volume successfully.
Sep 30 20:05:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0b8b521a-75ef-41d1-a1f8-4f0530af199e tempest-VolumesTransfersV355Test-226856869 None] Lock "cinder-211e86d2-a1ad-4230-b704-9b0f026d83e0-delete_volume" released by "delete_volume" :: held 0.416s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:27 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Flow 'volume_create_manager' (545ddc1b-5b2a-47df-a1e6-52e913681aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547de8d8-b868-473e-821a-88454a013869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547de8d8-b868-473e-821a-88454a013869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1608015797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1066e7ef-1f59-4be7-a774-6c0db320c5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0a0e900c084b798b74a65cfde66c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:28Z,use_quota=True,user_id='fdfa6c76fd7a431b9506c99c88a200d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed70b37-2f8c-4fed-8496-4a0185e178bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed70b37-2f8c-4fed-8496-4a0185e178bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e87c97c-093b-490e-8d77-951ac346b88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e87c97c-093b-490e-8d77-951ac346b88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1066e7ef-1f59-4be7-a774-6c0db320c5d3', 'volume_name': 'volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc90185-7958-40ca-8fad-d2e77d957c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc90185-7958-40ca-8fad-d2e77d957c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd95c069-e378-4a31-b592-2862e6d7b043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:27 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Volume 1066e7ef-1f59-4be7-a774-6c0db320c5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3', 'volume_size': 1}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1608015797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1066e7ef-1f59-4be7-a774-6c0db320c5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0a0e900c084b798b74a65cfde66c33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:28Z,use_quota=True,user_id='fdfa6c76fd7a431b9506c99c88a200d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Creating volume 1066e7ef-1f59-4be7-a774-6c0db320c5d3 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:05:27 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:05:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:27 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=34, name=volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:05:27 devstack quobyte-client[79699]: System call "lookup" of process 83847 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:27 devstack quobyte-client[79699]: System call "getattr" of process 83847 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3 1073741824" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] <== create_volume: return (153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.156s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd95c069-e378-4a31-b592-2862e6d7b043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef018ea2-3aab-44bb-948e-9ee377fb52bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:28 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Volume volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3 (1066e7ef-1f59-4be7-a774-6c0db320c5d3): created successfully
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef018ea2-3aab-44bb-948e-9ee377fb52bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Flow 'volume_create_manager' (545ddc1b-5b2a-47df-a1e6-52e913681aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c156ccaf-871b-4371-b4a6-fb5fd948f631 tempest-VolumesTransfersV355Test-162962574 None] Created volume successfully.
Sep 30 20:05:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-2fbbb431-3168-4b10-89a0-46c8c1676f33 tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-2fbbb431-3168-4b10-89a0-46c8c1676f33 tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-2fbbb431-3168-4b10-89a0-46c8c1676f33 tempest-TaggedBootDevicesTest-959373523 None] Terminate volume connection completed successfully.
Sep 30 20:05:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-2fbbb431-3168-4b10-89a0-46c8c1676f33 tempest-TaggedBootDevicesTest-959373523 None] Deleting attachment c5e33259-9d74-4237-993d-6f17e6640ee6. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:05:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-e8eb772a-9f83-487a-aa62-90996fdc800d tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-e8eb772a-9f83-487a-aa62-90996fdc800d tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-e8eb772a-9f83-487a-aa62-90996fdc800d tempest-TaggedBootDevicesTest-959373523 None] Terminate volume connection completed successfully.
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-e8eb772a-9f83-487a-aa62-90996fdc800d tempest-TaggedBootDevicesTest-959373523 None] Deleting attachment da702759-773e-490d-8751-61d4310a8ae9. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Acquiring lock "cinder-1066e7ef-1f59-4be7-a774-6c0db320c5d3-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Lock "cinder-1066e7ef-1f59-4be7-a774-6c0db320c5d3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Acquiring lock "cinder-quobyte-1066e7ef-1f59-4be7-a774-6c0db320c5d3" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Lock "cinder-quobyte-1066e7ef-1f59-4be7-a774-6c0db320c5d3" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6c73a-ca7c-4a24-bf59-a8ff34078971]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3" returned: 0 in 0.184s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1066e7ef-1f59-4be7-a774-6c0db320c5d3" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Lock "cinder-quobyte-1066e7ef-1f59-4be7-a774-6c0db320c5d3" released by "delete_volume" :: held 0.226s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Created reservations ['52b8a704-dd3e-466b-ad02-296c112b19ba', '66af0b6e-75eb-4ce2-ba98-7ff35d4166a7', 'a261351e-612a-486d-8b70-49801d63d384', '43a2da19-ccbf-4882-901b-27e972f9f54c'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Deleted volume successfully.
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1aca1604-1d2f-4c11-bb8d-d99df269dda4 tempest-VolumesTransfersV355Test-226856869 None] Lock "cinder-1066e7ef-1f59-4be7-a774-6c0db320c5d3-delete_volume" released by "delete_volume" :: held 0.373s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-68cc7051-1bfe-4ba1-a329-a2b36c720b8d tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-68cc7051-1bfe-4ba1-a329-a2b36c720b8d tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-68cc7051-1bfe-4ba1-a329-a2b36c720b8d tempest-TaggedBootDevicesTest-959373523 None] Terminate volume connection completed successfully.
Sep 30 20:05:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-bc44a89d-bde6-4bc0-ac8e-fe3d9f4ec68e req-68cc7051-1bfe-4ba1-a329-a2b36c720b8d tempest-TaggedBootDevicesTest-959373523 None] Deleting attachment c21375d3-7cf3-4a70-862a-2f8333eee054. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:05:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:05:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Flow 'volume_create_manager' (035d8fb3-0a0c-4b84-ae6b-9627d8ea3e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d83311-1160-484f-95a3-748a66afc454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d83311-1160-484f-95a3-748a66afc454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1264545146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5d0374de6a4ed285130c1138b32750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:35Z,use_quota=True,user_id='036c4ecc402a4686abd88a11b1f06885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24882f9-a49f-486d-a97c-0654f2db4f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24882f9-a49f-486d-a97c-0654f2db4f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230038cd-23e1-40b5-a187-361cda08492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230038cd-23e1-40b5-a187-361cda08492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d', 'volume_name': 'volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b7b9d7-8d9c-4d00-8b80-8afff9b71aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b7b9d7-8d9c-4d00-8b80-8afff9b71aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da10511-89fe-4285-91ac-e4f6d6e8b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Volume 4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d', 'volume_size': 1}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1264545146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5d0374de6a4ed285130c1138b32750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:05:35Z,use_quota=True,user_id='036c4ecc402a4686abd88a11b1f06885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Creating volume 4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:05:34 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:34 devstack quobyte-client[79699]: System call "lookup" of process 83861 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:05:34 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=35, name=volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d 1073741824" returned: 0 in 0.153s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] <== create_volume: return (193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.194s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da10511-89fe-4285-91ac-e4f6d6e8b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c03696-5c23-4f7e-af7f-acdda546a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:05:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Volume volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d (4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d): created successfully
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c03696-5c23-4f7e-af7f-acdda546a768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:05:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Flow 'volume_create_manager' (035d8fb3-0a0c-4b84-ae6b-9627d8ea3e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:05:34 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6379c135-0dfd-46e9-b8c1-3a21b04f553d tempest-VolumesNegativeTest-1380406813 None] Created volume successfully.
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "cinder-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:36 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "cinder-quobyte-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-quobyte-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcd0b87-ad1a-402f-b796-dfe897173606]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec" returned: 0 in 0.161s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec" returned: 0 in 0.041s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-quobyte-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec" released by "delete_volume" :: held 0.238s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:36 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Created reservations ['7e66101b-7609-4e23-b7ef-14bd74913885', '0b557656-d8c8-41c9-b4bb-c21c01b817bd', '1c12e2a9-9fc0-4cb8-8930-ef3cc9c64b9c', '8a52bd2b-83a9-41d4-b9e2-1de328eae520'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:37 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Deleted volume successfully.
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-cfd0a37a-b326-4b94-86f5-00cd82143c6e tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-b70c9d8e-0e7f-4fba-af6d-9c604a11e3ec-delete_volume" released by "delete_volume" :: held 0.429s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "cinder-28ad728b-0e77-4734-987d-69c5a2dac7ab-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-28ad728b-0e77-4734-987d-69c5a2dac7ab-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:37 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "cinder-quobyte-28ad728b-0e77-4734-987d-69c5a2dac7ab" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-quobyte-28ad728b-0e77-4734-987d-69c5a2dac7ab" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e863ee-f843-426a-a2b8-bc219edc389b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab" returned: 0 in 0.159s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-28ad728b-0e77-4734-987d-69c5a2dac7ab" returned: 0 in 0.054s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-quobyte-28ad728b-0e77-4734-987d-69c5a2dac7ab" released by "delete_volume" :: held 0.235s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Created reservations ['b2691439-9e54-4fb0-8bc2-5c2d2e51e8d2', 'f1c36d60-dd63-4dcf-93c8-82aaebe320fe', '8d08bedc-5004-496d-b088-91e19f724432', '142835b3-53d1-4ebd-9564-9f88ef044150'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:38 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Deleted volume successfully.
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3d078538-87ae-498f-8aa6-7355f800f0a8 tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-28ad728b-0e77-4734-987d-69c5a2dac7ab-delete_volume" released by "delete_volume" :: held 0.421s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "cinder-796a7369-5564-4298-a7ee-0edca148994e-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-796a7369-5564-4298-a7ee-0edca148994e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:38 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "cinder-quobyte-796a7369-5564-4298-a7ee-0edca148994e" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:05:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-quobyte-796a7369-5564-4298-a7ee-0edca148994e" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa54d45-a759-423a-99b4-9db1e6963014]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 0 in 0.173s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 1 in 0.145s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-796a7369-5564-4298-a7ee-0edca148994e" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-quobyte-796a7369-5564-4298-a7ee-0edca148994e" released by "delete_volume" :: held 0.399s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Created reservations ['ff06971a-814b-474c-8b79-18262854157a', 'e939e1c2-bcb1-4351-97b3-f8299a7c765e', '5c2625b9-6709-4587-bfe8-6b5cd00a55b2', '45906a59-96e6-451e-862f-69b2d9312a6e'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:39 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Deleted volume successfully.
Sep 30 20:05:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-76a9083c-770a-48ad-b466-e7e7bd58b42c tempest-TaggedBootDevicesTest-959373523 None] Lock "cinder-796a7369-5564-4298-a7ee-0edca148994e-delete_volume" released by "delete_volume" :: held 0.571s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:05:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:05:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:05:49 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=35,cinder:DELETE=5,cinder:INSERT=12,cinder:UPDATE=46 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:05:49 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=45,cinder:SELECT=27,cinder:INSERT=8,cinder:DELETE=3 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:05:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:05:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Acquiring lock "cinder-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Lock "cinder-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:13 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Acquiring lock "cinder-quobyte-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Lock "cinder-quobyte-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d" acquired by "delete_volume" :: waited 0.029s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8838bd05-3624-406b-889c-db812d46c06a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d" returned: 0 in 0.183s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Lock "cinder-quobyte-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d" released by "delete_volume" :: held 0.358s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Created reservations ['e67ccfa7-07b1-4094-81c5-030ac9f79fec', '89071ad8-6dd4-4223-a7ad-805be458eb8f', 'd6cc48d8-959e-489b-9d80-b8daeace38cd', 'f7e38018-3050-4781-80c1-e828e3870ace'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:06:13 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Deleted volume successfully.
Sep 30 20:06:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-706de1e9-9478-4299-bf78-ab5f4294184e tempest-VolumesNegativeTest-1380406813 None] Lock "cinder-4e37fb55-2c36-4b08-89e5-5fcf2bef1f4d-delete_volume" released by "delete_volume" :: held 0.621s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:16 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Flow 'volume_create_manager' (96ca2f33-a983-4d7e-90c0-0d51cf685d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5d00a7-b95c-448d-b33a-5f40e8c27f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5d00a7-b95c-448d-b33a-5f40e8c27f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-495900151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a11efab-97bf-44f8-a8cc-15694a381d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f4c347891d4c0ba878b69590f25b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:16Z,use_quota=True,user_id='55939886947747c1812c32ae2a042d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b0b8f7-f87c-4f6d-b214-536a97e17ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b0b8f7-f87c-4f6d-b214-536a97e17ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9feabe21-501d-473b-bc4e-99bac5bb48c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9feabe21-501d-473b-bc4e-99bac5bb48c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a11efab-97bf-44f8-a8cc-15694a381d11', 'volume_name': 'volume-0a11efab-97bf-44f8-a8cc-15694a381d11', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fd5069-5fc9-4a67-9e35-bf6c960a0057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fd5069-5fc9-4a67-9e35-bf6c960a0057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb214ca-d28b-418d-8c7d-a94abb07630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume 0a11efab-97bf-44f8-a8cc-15694a381d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a11efab-97bf-44f8-a8cc-15694a381d11', 'volume_size': 1}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-495900151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a11efab-97bf-44f8-a8cc-15694a381d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08f4c347891d4c0ba878b69590f25b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:16Z,use_quota=True,user_id='55939886947747c1812c32ae2a042d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Creating volume 0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:06:16 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:16 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=36, name=volume-0a11efab-97bf-44f8-a8cc-15694a381d11, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 1073741824" returned: 0 in 0.132s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] <== create_volume: return (161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.163s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb214ca-d28b-418d-8c7d-a94abb07630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a11efab-97bf-44f8-a8cc-15694a381d11', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2a372e-2801-4768-ae91-5d17619ecf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume volume-0a11efab-97bf-44f8-a8cc-15694a381d11 (0a11efab-97bf-44f8-a8cc-15694a381d11): created successfully
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b2a372e-2801-4768-ae91-5d17619ecf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Flow 'volume_create_manager' (96ca2f33-a983-4d7e-90c0-0d51cf685d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:16 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f25923bf-9f22-49f7-8ee8-342af27ed3d1 tempest-VolumesSnapshotListTestJSON-467606044 None] Created volume successfully.
Sep 30 20:06:17 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Creating offline snapshot c35b64f9-7e19-4654-921c-4ee0bee406dd of volume 0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[45648dc8-e095-48f6-932e-e6d3c830572f]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11" returned: 0 in 0.230s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:17 devstack quobyte-client[79699]: System call "lookup" of process 84332 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:17 devstack quobyte-client[79699]: System call "getattr" of process 84332 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:17 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=37, name=volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd 1G" returned: 0 in 0.217s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0a11efab-97bf-44f8-a8cc-15694a381d11 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:17 devstack quobyte-client[79699]: System call "lookup" of process 84335 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:17 devstack quobyte-client[79699]: System call "getattr" of process 84335 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img rebase -u -b volume-0a11efab-97bf-44f8-a8cc-15694a381d11 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd" returned: 0 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd" returned: 0 in 0.056s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.info" returned: 0 in 0.051s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:06:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.info" returned: 0 in 0.030s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.798s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:18 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b455d415-3f5f-4f48-9308-1edd8f28e3d3 tempest-VolumesSnapshotListTestJSON-467606044 None] Create snapshot completed successfully
Sep 30 20:06:18 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Creating offline snapshot a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b of volume 0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc871bb-7046-4615-aa77-7ae7a2bc575b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd" returned: 0 in 0.152s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a11efab-97bf-44f8-a8cc-15694a381d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:18 devstack quobyte-client[79699]: System call "open" of process 84353 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:18 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=39, name=volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b 1G" returned: 0 in 0.102s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img rebase -u -b volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" returned: 0 in 0.041s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" returned: 0 in 0.026s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.418s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:18 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a0c7432f-95a1-4f33-9a6a-c25fa93388f3 tempest-VolumesSnapshotListTestJSON-467606044 None] Create snapshot completed successfully
Sep 30 20:06:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:19 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Creating offline snapshot 43367422-00a1-4ce5-a074-8ffe5cc3411b of volume 0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:06:19 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8ee60d-7b98-41cb-bea7-4f50cdce36d0]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:19 devstack quobyte-client[79699]: System call "open" of process 84361 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" returned: 0 in 0.179s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a11efab-97bf-44f8-a8cc-15694a381d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:06:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:19 devstack quobyte-client[79699]: System call "open" of process 84364 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:19 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=40, name=volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b 1G" returned: 0 in 0.162s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img rebase -u -b volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b" returned: 0 in 0.045s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b" returned: 0 in 0.051s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.543s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-96da24c8-f549-4d76-9219-a682ee89b6d9 tempest-VolumesSnapshotListTestJSON-467606044 None] Create snapshot completed successfully
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-43367422-00a1-4ce5-a074-8ffe5cc3411b-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-43367422-00a1-4ce5-a074-8ffe5cc3411b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:21 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" acquired by "delete_snapshot" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-quobyte-43367422-00a1-4ce5-a074-8ffe5cc3411b" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-43367422-00a1-4ce5-a074-8ffe5cc3411b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Deleting offline snapshot 43367422-00a1-4ce5-a074-8ffe5cc3411b of volume 0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] snapshot_file for this snap is: volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faea3dd-d11f-4be5-80ba-eb6ee9accc62]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a11efab-97bf-44f8-a8cc-15694a381d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf34c92-4b89-4d68-b471-6447cd36786e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" returned: 0 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a11efab-97bf-44f8-a8cc-15694a381d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:21 devstack quobyte-client[79699]: System call "open" of process 84378 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b" returned: 0 in 0.117s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.43367422-00a1-4ce5-a074-8ffe5cc3411b" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-43367422-00a1-4ce5-a074-8ffe5cc3411b" released by "_delete_snapshot" :: held 0.466s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" released by "delete_snapshot" :: held 0.482s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Created reservations ['bf811ec6-1936-44aa-bcad-833911749d55', '53b99683-42d4-4772-9f3a-99912c0e723f', '68400d9c-77d8-491d-a567-fe0f62701079', '8c1b4538-20e2-484b-9c4f-bc984d583fe4'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:06:21 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Delete snapshot completed successfully.
Sep 30 20:06:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bba5000a-4a8c-4935-a83d-c8bf79af2a26 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-43367422-00a1-4ce5-a074-8ffe5cc3411b-delete_snapshot" released by "delete_snapshot" :: held 0.583s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-19018dbb-82b8-40a8-b7f6-e81ef06aa27e req-1fe8da3e-f025-4d1f-950b-4fb5e31a66ce tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-19018dbb-82b8-40a8-b7f6-e81ef06aa27e req-1fe8da3e-f025-4d1f-950b-4fb5e31a66ce tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:22 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-19018dbb-82b8-40a8-b7f6-e81ef06aa27e req-1fe8da3e-f025-4d1f-950b-4fb5e31a66ce tempest-AttachVolumeTestJSON-143237044 None] Terminate volume connection completed successfully.
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-19018dbb-82b8-40a8-b7f6-e81ef06aa27e req-1fe8da3e-f025-4d1f-950b-4fb5e31a66ce tempest-AttachVolumeTestJSON-143237044 None] Deleting attachment 82c4bc15-14a7-40e6-975b-1cd56d70ef83. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" acquired by "delete_snapshot" :: waited 0.017s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-quobyte-a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Deleting offline snapshot a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b of volume 0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] snapshot_file for this snap is: volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a7757-a67f-4b18-aad4-a71cc080f460]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" returned: 0 in 0.199s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a11efab-97bf-44f8-a8cc-15694a381d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3c34e6-2848-45b3-8857-1910779bd683]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:22 devstack quobyte-client[79699]: System call "open" of process 84387 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd" returned: 0 in 0.189s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a11efab-97bf-44f8-a8cc-15694a381d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:23 devstack quobyte-client[79699]: System call "open" of process 84390 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" returned: 0 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" returned: 0 in 0.041s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b" released by "_delete_snapshot" :: held 0.661s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" released by "delete_snapshot" :: held 0.683s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Created reservations ['a48b43ac-385c-42c3-9a3c-b5bde919fe9b', 'bac7f2f6-c9d8-48a2-aea9-a9c3f2bd43ba', '7fa220b4-1748-44bd-b2d8-f0d5c810887f', '1a10ec5d-fd16-41dc-82a6-2edb9292ac0c'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:06:23 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Delete snapshot completed successfully.
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ca87a86b-9e16-4288-b77f-aebc350aab8a tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-a42302c0-ddcc-4fc3-a1e1-3c2af68ec35b-delete_snapshot" released by "delete_snapshot" :: held 0.819s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-c35b64f9-7e19-4654-921c-4ee0bee406dd-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-c35b64f9-7e19-4654-921c-4ee0bee406dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:23 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" acquired by "delete_snapshot" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-quobyte-c35b64f9-7e19-4654-921c-4ee0bee406dd" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-c35b64f9-7e19-4654-921c-4ee0bee406dd" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Deleting offline snapshot c35b64f9-7e19-4654-921c-4ee0bee406dd of volume 0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] snapshot_file for this snap is: volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb37843-e516-4e99-841e-1aea1af7b294]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:24 devstack quobyte-client[79699]: System call "lookup" of process 84394 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:24 devstack quobyte-client[79699]: System call "getattr" of process 84394 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:24 devstack quobyte-client[79699]: System call "open" of process 84394 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd" returned: 0 in 0.278s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a11efab-97bf-44f8-a8cc-15694a381d11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[235a461c-1f42-49d4-b305-547cd2037617]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:24 devstack quobyte-client[79699]: System call "lookup" of process 84397 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:24 devstack quobyte-client[79699]: System call "getattr" of process 84397 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:24 devstack quobyte-client[79699]: System call "open" of process 84397 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11" returned: 0 in 0.193s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd" returned: 0 in 0.093s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11.c35b64f9-7e19-4654-921c-4ee0bee406dd" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-c35b64f9-7e19-4654-921c-4ee0bee406dd" released by "_delete_snapshot" :: held 0.728s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" released by "delete_snapshot" :: held 0.774s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Created reservations ['9a64b343-ae06-40a9-acfe-a233cde1c987', '444e0763-822d-472d-b9bf-b0867918db0f', '70be7af8-41d2-4f83-8f0b-79bb9742974c', '812430fb-b126-47ee-b733-b83c4ca7b041'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:06:24 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Delete snapshot completed successfully.
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f76ef36e-d616-40b7-8d4d-f4553b8dddb4 tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-c35b64f9-7e19-4654-921c-4ee0bee406dd-delete_snapshot" released by "delete_snapshot" :: held 0.904s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-0a11efab-97bf-44f8-a8cc-15694a381d11-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-0a11efab-97bf-44f8-a8cc-15694a381d11-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" acquired by "delete_volume" :: waited 0.018s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f7a5a0-b58d-4e17-990e-553332f59ffb]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11" returned: 0 in 0.416s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0a11efab-97bf-44f8-a8cc-15694a381d11" returned: 0 in 0.044s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-quobyte-0a11efab-97bf-44f8-a8cc-15694a381d11" released by "delete_volume" :: held 0.532s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Created reservations ['5ac6ecd0-33c2-46af-adf7-9f55a7d1ca6f', 'c47bf505-3083-432a-bfec-14e2dd06906d', 'ab4f2578-5f1b-45f7-b39e-a063372f6680', '6ad1d28d-7668-454b-a06c-2d3604647809'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.049s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:06:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Deleted volume successfully.
Sep 30 20:06:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-caed0a9c-6f22-43d3-b9ea-688f04cbe5cf tempest-VolumesSnapshotListTestJSON-467606044 None] Lock "cinder-0a11efab-97bf-44f8-a8cc-15694a381d11-delete_volume" released by "delete_volume" :: held 0.970s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:35 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=32,cinder:UPDATE=34,cinder:DELETE=2,cinder:INSERT=7 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:06:35 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=28,cinder:INSERT=13,cinder:UPDATE=41,cinder:DELETE=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:06:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:45 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Flow 'volume_create_manager' (9d5b8326-c29e-4735-bd61-f5826232ef45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87800524-f2ff-45bf-bd07-dc7828f73131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87800524-f2ff-45bf-bd07-dc7828f73131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1929132508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac279ed-6f36-49cb-b797-20ec62d8256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a0faab5fc8454ab87c3aad06012bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:45Z,use_quota=True,user_id='41939ac8720b4ad698be598c0c86d6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f48fe4-2cc6-40db-9e0e-3a732131672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f48fe4-2cc6-40db-9e0e-3a732131672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b614d0-f6cc-426a-982f-c2d43aea11ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b614d0-f6cc-426a-982f-c2d43aea11ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac279ed-6f36-49cb-b797-20ec62d8256b', 'volume_name': 'volume-dac279ed-6f36-49cb-b797-20ec62d8256b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd429a62-64c7-4dd8-a219-2c81c540db8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd429a62-64c7-4dd8-a219-2c81c540db8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d9dcf2-a0e1-4b9f-a3e1-2607bc50b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:45 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Volume dac279ed-6f36-49cb-b797-20ec62d8256b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac279ed-6f36-49cb-b797-20ec62d8256b', 'volume_size': 1}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1929132508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac279ed-6f36-49cb-b797-20ec62d8256b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a0faab5fc8454ab87c3aad06012bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:45Z,use_quota=True,user_id='41939ac8720b4ad698be598c0c86d6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Creating volume dac279ed-6f36-49cb-b797-20ec62d8256b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:06:45 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-dac279ed-6f36-49cb-b797-20ec62d8256b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:45 devstack quobyte-client[79699]: System call "lookup" of process 84738 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:45 devstack quobyte-client[79699]: System call "lookup" of process 84738 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:45 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=41, name=volume-dac279ed-6f36-49cb-b797-20ec62d8256b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-dac279ed-6f36-49cb-b797-20ec62d8256b 1073741824" returned: 0 in 0.653s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-dac279ed-6f36-49cb-b797-20ec62d8256b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-dac279ed-6f36-49cb-b797-20ec62d8256b" returned: 0 in 0.086s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:06:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d9dcf2-a0e1-4b9f-a3e1-2607bc50b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac279ed-6f36-49cb-b797-20ec62d8256b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40878c60-dd59-40e9-befa-eefb8f569dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:46 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Volume volume-dac279ed-6f36-49cb-b797-20ec62d8256b (dac279ed-6f36-49cb-b797-20ec62d8256b): created successfully
Sep 30 20:06:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40878c60-dd59-40e9-befa-eefb8f569dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Flow 'volume_create_manager' (9d5b8326-c29e-4735-bd61-f5826232ef45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1f987fea-70ff-4673-ac94-6053d48bdf4e tempest-ServersNegativeTestJSON-238872635 None] Created volume successfully.
Sep 30 20:06:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:49 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Flow 'volume_create_manager' (f17847eb-5e07-43c9-9363-f06b6767d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a98b8db-308c-4d98-b7fb-2f872ed4057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a98b8db-308c-4d98-b7fb-2f872ed4057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1260425960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e8a09e-0d4c-4d05-938b-37bdbdf80dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a0faab5fc8454ab87c3aad06012bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:50Z,use_quota=True,user_id='41939ac8720b4ad698be598c0c86d6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75b1f41-b8b8-4991-822f-04e1f64baf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75b1f41-b8b8-4991-822f-04e1f64baf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc89218-2e9e-4779-b909-7a594d24f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc89218-2e9e-4779-b909-7a594d24f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e8a09e-0d4c-4d05-938b-37bdbdf80dfc', 'volume_name': 'volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f65b360-c9fa-48d4-9b87-14b646ff5737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f65b360-c9fa-48d4-9b87-14b646ff5737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a350e2-3f8f-49d7-a773-e44a522fa3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:49 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Volume 61e8a09e-0d4c-4d05-938b-37bdbdf80dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc', 'volume_size': 1}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1260425960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e8a09e-0d4c-4d05-938b-37bdbdf80dfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39a0faab5fc8454ab87c3aad06012bf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:50Z,use_quota=True,user_id='41939ac8720b4ad698be598c0c86d6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Creating volume 61e8a09e-0d4c-4d05-938b-37bdbdf80dfc {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:06:49 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:06:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:49 devstack quobyte-client[79699]: System call "lookup" of process 84744 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:49 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=42, name=volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc 1073741824" returned: 0 in 0.612s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc" returned: 0 in 0.071s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a350e2-3f8f-49d7-a773-e44a522fa3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c596babe-338b-40a8-8277-15bd5d369246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:50 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Volume volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc (61e8a09e-0d4c-4d05-938b-37bdbdf80dfc): created successfully
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c596babe-338b-40a8-8277-15bd5d369246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:50 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Flow 'volume_create_manager' (f17847eb-5e07-43c9-9363-f06b6767d86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:50 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-52369493-3915-4b6e-bf78-1f8884f1c0a2 tempest-ServersNegativeTestJSON-238872635 None] Created volume successfully.
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "cinder-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Lock "cinder-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:51 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "cinder-quobyte-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Lock "cinder-quobyte-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1274ff31-2590-4323-89a5-d8da2c535715]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:51 devstack quobyte-client[79699]: System call "getattr" of process 84748 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc" returned: 0 in 0.161s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Lock "cinder-quobyte-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc" released by "delete_volume" :: held 0.264s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Created reservations ['00b98512-6981-4e23-b99f-1004f1801837', '1a256d3b-c9f7-4a45-8182-8261a4743b1d', '7c0308a1-0ac5-4c99-b0c4-17868aef65e9', '71a763c4-258e-422d-ab9b-ccf3c0e7cfa7'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:06:51 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Deleted volume successfully.
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6152da20-a29c-4039-8748-3ec594dd8ac0 tempest-ServersNegativeTestJSON-238872635 None] Lock "cinder-61e8a09e-0d4c-4d05-938b-37bdbdf80dfc-delete_volume" released by "delete_volume" :: held 0.465s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.038s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:06:51 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Flow 'volume_create_manager' (03d1b134-c392-4f97-b98d-58a000c534a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b32e8c-2659-463b-a3c9-5098d7bb0ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b32e8c-2659-463b-a3c9-5098d7bb0ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1900432673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13a12e7-9f4f-4388-a197-51a81f7dcccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f3e5e31f164f2ba092f8a3b9ec9a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:52Z,use_quota=True,user_id='00cf7564748546e280682116d30ff6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4704a262-7c87-4780-9907-5aa1419719ab),volume_type_id=4704a262-7c87-4780-9907-5aa1419719ab)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6233b8d-c022-43b4-a6c0-9f79cfca4585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6233b8d-c022-43b4-a6c0-9f79cfca4585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54578448-1c6e-41ab-a2a7-06cb7271d0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54578448-1c6e-41ab-a2a7-06cb7271d0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13a12e7-9f4f-4388-a197-51a81f7dcccf', 'volume_name': 'volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4122280-a5bf-47a3-88e1-2d2edf3704b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4122280-a5bf-47a3-88e1-2d2edf3704b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f50792-66f6-422d-ab7f-53128f50bcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Volume e13a12e7-9f4f-4388-a197-51a81f7dcccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf', 'volume_size': 1}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1900432673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13a12e7-9f4f-4388-a197-51a81f7dcccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f3e5e31f164f2ba092f8a3b9ec9a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:52Z,use_quota=True,user_id='00cf7564748546e280682116d30ff6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4704a262-7c87-4780-9907-5aa1419719ab),volume_type_id=4704a262-7c87-4780-9907-5aa1419719ab)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Creating volume e13a12e7-9f4f-4388-a197-51a81f7dcccf {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:52 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=43, name=volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf 1073741824" returned: 0 in 0.148s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf" returned: 0 in 0.045s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] <== create_volume: return (209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.212s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f50792-66f6-422d-ab7f-53128f50bcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62891049-58ab-4369-8d03-5f43191193b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Flow 'volume_create_manager' (3f57c6fd-c28b-4e24-920f-e091d5362413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658b3853-1a38-4b84-9da4-e7b1380d0dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "cinder-dac279ed-6f36-49cb-b797-20ec62d8256b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Volume volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf (e13a12e7-9f4f-4388-a197-51a81f7dcccf): created successfully
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62891049-58ab-4369-8d03-5f43191193b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Flow 'volume_create_manager' (03d1b134-c392-4f97-b98d-58a000c534a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658b3853-1a38-4b84-9da4-e7b1380d0dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1329171685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51a0ada-4577-4822-939a-3ba4beed30f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f3e5e31f164f2ba092f8a3b9ec9a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:52Z,use_quota=True,user_id='00cf7564748546e280682116d30ff6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15f4a813-bd6c-4e9c-9582-79df8ba00806),volume_type_id=15f4a813-bd6c-4e9c-9582-79df8ba00806)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61157f0c-93e7-4cf5-a90c-8c2653cd98a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61157f0c-93e7-4cf5-a90c-8c2653cd98a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0edb5b0-2eb0-4f84-a49c-d7f895d36360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0edb5b0-2eb0-4f84-a49c-d7f895d36360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51a0ada-4577-4822-939a-3ba4beed30f3', 'volume_name': 'volume-a51a0ada-4577-4822-939a-3ba4beed30f3', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47894b5d-7e71-48e1-ad0d-c73039d70475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47894b5d-7e71-48e1-ad0d-c73039d70475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9b40a4-b340-4eb6-8afd-c6ed3ea12299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume a51a0ada-4577-4822-939a-3ba4beed30f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51a0ada-4577-4822-939a-3ba4beed30f3', 'volume_size': 1}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1329171685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51a0ada-4577-4822-939a-3ba4beed30f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f3e5e31f164f2ba092f8a3b9ec9a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:52Z,use_quota=True,user_id='00cf7564748546e280682116d30ff6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15f4a813-bd6c-4e9c-9582-79df8ba00806),volume_type_id=15f4a813-bd6c-4e9c-9582-79df8ba00806)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Creating volume a51a0ada-4577-4822-939a-3ba4beed30f3 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-cec54b01-ca42-45fc-9ce6-40bd5a86dd4d tempest-TestInstancesWithCinderVolumes-169740844 None] Created volume successfully.
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Lock "cinder-dac279ed-6f36-49cb-b797-20ec62d8256b-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:52 devstack quobyte-client[79699]: System call "lookup" of process 84758 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:52 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=44, name=volume-a51a0ada-4577-4822-939a-3ba4beed30f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "cinder-quobyte-dac279ed-6f36-49cb-b797-20ec62d8256b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Lock "cinder-quobyte-dac279ed-6f36-49cb-b797-20ec62d8256b" acquired by "delete_volume" :: waited 0.023s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d57af-7c8d-43a6-8386-c71b07bf2f69]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-dac279ed-6f36-49cb-b797-20ec62d8256b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Flow 'volume_create_manager' (f63fd1d7-95cf-49c1-95fd-9f35920ac6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b5a46b-7229-4b73-a721-5cde8324bd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3 1073741824" returned: 0 in 0.242s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b5a46b-7229-4b73-a721-5cde8324bd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1431652796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a53cb9-aeee-4c8d-a268-474990f0ae91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f3e5e31f164f2ba092f8a3b9ec9a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:53Z,use_quota=True,user_id='00cf7564748546e280682116d30ff6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81bd8d9d-0dff-4345-862f-82790f6ababc),volume_type_id=81bd8d9d-0dff-4345-862f-82790f6ababc)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993a79fe-3bfd-4d91-b071-a4bdf7ba46ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993a79fe-3bfd-4d91-b071-a4bdf7ba46ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ba1d8b-cbee-4458-8b3d-b6b7a84a3679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.image.glance [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Creating Keystone auth plugin from conf {{(pid=79893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3" returned: 0 in 0.047s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] <== create_volume: return (297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.300s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9b40a4-b340-4eb6-8afd-c6ed3ea12299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51a0ada-4577-4822-939a-3ba4beed30f3', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7319982-403b-40a4-ae91-965372dadc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume volume-a51a0ada-4577-4822-939a-3ba4beed30f3 (a51a0ada-4577-4822-939a-3ba4beed30f3): created successfully
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7319982-403b-40a4-ae91-965372dadc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Flow 'volume_create_manager' (3f57c6fd-c28b-4e24-920f-e091d5362413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-69a5c9ff-092e-45d6-b065-ec2ff4a82fb9 tempest-TestInstancesWithCinderVolumes-169740844 None] Created volume successfully.
Sep 30 20:06:52 devstack quobyte-client[79699]: System call "open" of process 84761 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-dac279ed-6f36-49cb-b797-20ec62d8256b" returned: 0 in 0.231s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-dac279ed-6f36-49cb-b797-20ec62d8256b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-dac279ed-6f36-49cb-b797-20ec62d8256b" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Lock "cinder-quobyte-dac279ed-6f36-49cb-b797-20ec62d8256b" released by "delete_volume" :: held 0.288s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ba1d8b-cbee-4458-8b3d-b6b7a84a3679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '64a53cb9-aeee-4c8d-a268-474990f0ae91', 'volume_name': 'volume-64a53cb9-aeee-4c8d-a268-474990f0ae91', 'volume_size': 1, 'image_id': '14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1593727904', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd1f3e5e31f164f2ba092f8a3b9ec9a58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'created_at': datetime.datetime(2025, 9, 30, 18, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733b44430>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b2dd6d-3f02-43a9-938a-54372ec18a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b2dd6d-3f02-43a9-938a-54372ec18a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569985ec-e27b-4cf7-85f9-25b45c43f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:52 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume 64a53cb9-aeee-4c8d-a268-474990f0ae91: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-64a53cb9-aeee-4c8d-a268-474990f0ae91', 'volume_size': 1, 'image_id': '14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1593727904', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd1f3e5e31f164f2ba092f8a3b9ec9a58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'created_at': datetime.datetime(2025, 9, 30, 18, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733b44430>}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Cloning 64a53cb9-aeee-4c8d-a268-474990f0ae91 from image 14f24399-eb99-4d5e-8364-c60e0ca83ab1  at location (None, [{'url': 'file:///opt/stack/data/glance/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'metadata': {}}]). {{(pid=79893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 30 20:06:52 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Created reservations ['e50828ec-9042-40f7-8d84-6800f2abc58e', '0f72f763-8c80-461a-a4f1-1f10659e94bd', 'f186b1b3-60f2-43cc-88e6-6331229bb57c', 'cc81ec0d-3dec-4a90-b822-73a382fc8427'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:06:53 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Deleted volume successfully.
Sep 30 20:06:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2a4966e4-b79b-4316-87b4-c65ba20d8f77 tempest-ServersNegativeTestJSON-238872635 None] Lock "cinder-dac279ed-6f36-49cb-b797-20ec62d8256b-delete_volume" released by "delete_volume" :: held 0.617s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:06:54 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD, size 20.69 MB, duration 1.08 sec {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 20:06:54 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Image download 20.69 MB at 19.14 MB/s
Sep 30 20:06:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3733e4-3c61-4ac8-bb93-69220af39c57]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:54 devstack sudo[84767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD
Sep 30 20:06:54 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:06:54 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root
Sep 30 20:06:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:54 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Temporary image 14f24399-eb99-4d5e-8364-c60e0ca83ab1 is fetched for user 00cf7564748546e280682116d30ff6a3. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 20:06:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249035c-0229-44c8-980e-455ff3bace91]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:54 devstack sudo[84772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD
Sep 30 20:06:54 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:06:55 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1431652796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a53cb9-aeee-4c8d-a268-474990f0ae91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1f3e5e31f164f2ba092f8a3b9ec9a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:06:53Z,use_quota=True,user_id='00cf7564748546e280682116d30ff6a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81bd8d9d-0dff-4345-862f-82790f6ababc),volume_type_id=81bd8d9d-0dff-4345-862f-82790f6ababc)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Creating volume 64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:06:55 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:55 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=45, name=volume-64a53cb9-aeee-4c8d-a268-474990f0ae91, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 1073741824" returned: 0 in 0.124s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 0 in 0.030s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] <== create_volume: return (164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.171s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Attempting download of 14f24399-eb99-4d5e-8364-c60e0ca83ab1 ((None, [{'url': 'file:///opt/stack/data/glance/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'metadata': {}}])) to volume 64a53cb9-aeee-4c8d-a268-474990f0ae91. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[138ab348-ae7e-42aa-a18a-a6db8fc4d138]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14f24399-eb99-4d5e-8364-c60e0ca83ab1_r3yxsyxb {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14f24399-eb99-4d5e-8364-c60e0ca83ab1_r3yxsyxb" returned: 0 in 0.186s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14f24399-eb99-4d5e-8364-c60e0ca83ab1_r3yxsyxb {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14f24399-eb99-4d5e-8364-c60e0ca83ab1_r3yxsyxb" returned: 1 in 0.121s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14f24399-eb99-4d5e-8364-c60e0ca83ab1_r3yxsyxb' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[787fbd11-9a2e-4b65-98c4-b95f2a4898be]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] 14f24399-eb99-4d5e-8364-c60e0ca83ab1 was qcow2, converting to raw {{(pid=79893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:56 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=45, name=volume-64a53cb9-aeee-4c8d-a268-474990f0ae91, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:06:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 0 in 0.485s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14f24399-eb99-4d5e-8364-c60e0ca83ab1_bv9_fq3gdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:06:56 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:56 devstack quobyte-client[79699]: System call "lookup" of process 84901 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:56 devstack quobyte-client[79699]: System call "getattr" of process 84901 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:56 devstack quobyte-client[79699]: System call "open" of process 84901 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 1G" returned: 0 in 0.085s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7cd40f-a4e7-4c25-80d1-63d8ff302b2d]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:56 devstack quobyte-client[79699]: System call "getattr" of process 84904 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:56 devstack quobyte-client[79699]: System call "lookup" of process 84904 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:56 devstack quobyte-client[79699]: System call "open" of process 84904 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 0 in 0.190s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 1 in 0.173s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Downloaded image 14f24399-eb99-4d5e-8364-c60e0ca83ab1 ((None, [{'url': 'file:///opt/stack/data/glance/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'metadata': {}}])) to volume 64a53cb9-aeee-4c8d-a268-474990f0ae91 successfully. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Temporary image 14f24399-eb99-4d5e-8364-c60e0ca83ab1 for user 00cf7564748546e280682116d30ff6a3 is deleted. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Marking volume 64a53cb9-aeee-4c8d-a268-474990f0ae91 as bootable. {{(pid=79893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Copying metadata from image 14f24399-eb99-4d5e-8364-c60e0ca83ab1 to 64a53cb9-aeee-4c8d-a268-474990f0ae91. {{(pid=79893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Creating volume glance metadata for volume 64a53cb9-aeee-4c8d-a268-474990f0ae91 backed by image 14f24399-eb99-4d5e-8364-c60e0ca83ab1 with: {'image_id': '14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'image_name': 'tempest-scenario-img--1593727904', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=79893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569985ec-e27b-4cf7-85f9-25b45c43f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a53cb9-aeee-4c8d-a268-474990f0ae91', 'volume_size': 1, 'image_id': '14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1593727904', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd1f3e5e31f164f2ba092f8a3b9ec9a58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14f24399-eb99-4d5e-8364-c60e0ca83ab1', 'created_at': datetime.datetime(2025, 9, 30, 18, 6, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 6, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14f24399-eb99-4d5e-8364-c60e0ca83ab1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733b44430>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40858e9-ca4e-45bd-a730-1a9b46a5cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:06:57 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 (64a53cb9-aeee-4c8d-a268-474990f0ae91): created successfully
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40858e9-ca4e-45bd-a730-1a9b46a5cd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:06:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Flow 'volume_create_manager' (f63fd1d7-95cf-49c1-95fd-9f35920ac6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:06:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6c99852e-e61e-43c8-a591-dc976a1233e3 tempest-TestInstancesWithCinderVolumes-169740844 None] Created volume successfully.
Sep 30 20:07:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:07:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:04 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9792a671-6c0d-454e-8763-2a4c20760ac4]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:07:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 0 in 0.287s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 1 in 0.289s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:07:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.626s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-64a53cb9-aeee-4c8d-a268-474990f0ae91', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '975add08-57b3-4599-a764-07fa6786a32d', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:07:05 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:05 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-835cc233-9afb-4623-b462-724bf1410840 req-153c7495-5490-47cf-9c3b-f9f249f9d8f0 tempest-TestInstancesWithCinderVolumes-169740844 None] attachment_update completed successfully.
Sep 30 20:07:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dff388f1-85a0-4bce-98aa-8c2c2ee0dc6e tempest-BackendsCapabilitiesAdminTestsJSON-713414852 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 231.08221435546875, 'free_capacity_gb': 231.08221435546875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=79893) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 30 20:07:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee7842de-1a51-49fe-b842-1aee06305814 tempest-BackendsCapabilitiesAdminTestsJSON-713414852 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 231.08221435546875, 'free_capacity_gb': 231.08221435546875, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=79893) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 30 20:07:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:07:14 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Flow 'volume_create_manager' (ebf78818-946e-4dfa-ad19-12fe3ec1170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe26f076-e3c2-4bf1-9a46-cf5c070ddf76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe26f076-e3c2-4bf1-9a46-cf5c070ddf76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-734872133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ac305e-abdb-4539-8d3f-81e7fe33554d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261fb1c2440d4c1dbeabb585b58a56b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:07:15Z,use_quota=True,user_id='410706884ad8482ebfba0bb57be092ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a44a6b3-ad51-470e-a36d-01eb941eb91a),volume_type_id=8a44a6b3-ad51-470e-a36d-01eb941eb91a)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bef22f-77de-44d4-b620-b90fc20f89e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bef22f-77de-44d4-b620-b90fc20f89e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db98e007-f39b-4387-a6ab-af7d47d61a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db98e007-f39b-4387-a6ab-af7d47d61a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ac305e-abdb-4539-8d3f-81e7fe33554d', 'volume_name': 'volume-26ac305e-abdb-4539-8d3f-81e7fe33554d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8caa00-2403-4c86-8dca-28d4b1f89e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8caa00-2403-4c86-8dca-28d4b1f89e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0c88e1-71a2-4773-81fe-3ecd602a1198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:14 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Volume 26ac305e-abdb-4539-8d3f-81e7fe33554d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ac305e-abdb-4539-8d3f-81e7fe33554d', 'volume_size': 1}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-734872133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ac305e-abdb-4539-8d3f-81e7fe33554d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='261fb1c2440d4c1dbeabb585b58a56b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:07:15Z,use_quota=True,user_id='410706884ad8482ebfba0bb57be092ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a44a6b3-ad51-470e-a36d-01eb941eb91a),volume_type_id=8a44a6b3-ad51-470e-a36d-01eb941eb91a)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Creating volume 26ac305e-abdb-4539-8d3f-81e7fe33554d {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:07:14 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:07:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26ac305e-abdb-4539-8d3f-81e7fe33554d 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:15 devstack quobyte-client[79699]: System call "setlk" of process 85444 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:07:15 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=46, name=volume-26ac305e-abdb-4539-8d3f-81e7fe33554d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26ac305e-abdb-4539-8d3f-81e7fe33554d 1073741824" returned: 0 in 0.125s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26ac305e-abdb-4539-8d3f-81e7fe33554d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26ac305e-abdb-4539-8d3f-81e7fe33554d" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] <== create_volume: return (167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.169s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0c88e1-71a2-4773-81fe-3ecd602a1198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ac305e-abdb-4539-8d3f-81e7fe33554d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd388c6-9eaa-4b4a-a244-55f2e2478866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:15 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Volume volume-26ac305e-abdb-4539-8d3f-81e7fe33554d (26ac305e-abdb-4539-8d3f-81e7fe33554d): created successfully
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd388c6-9eaa-4b4a-a244-55f2e2478866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Flow 'volume_create_manager' (ebf78818-946e-4dfa-ad19-12fe3ec1170f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:07:15 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-db7dbfc4-9d18-4cd9-a39a-1b57c3d388b3 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Created volume successfully.
Sep 30 20:07:16 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:07:16 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-4cd52b85-0e5f-4be0-9681-f1709ce2bcb2 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Retype volume completed successfully.
Sep 30 20:07:16 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Flow 'volume_create_manager' (810c8cef-a023-4913-aefb-dec7cc45170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e17336-c0d1-45c9-83cc-6876633dcc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e17336-c0d1-45c9-83cc-6876633dcc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1405187101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a8a65d-df61-40ac-88c9-f02eb3665c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf4c18d6e32046fe83d03380b30f25c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:07:16Z,use_quota=True,user_id='f79a8f59963c4bb4a624e949355b57c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fd923b-c0c4-44dd-a46a-beacef9779c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fd923b-c0c4-44dd-a46a-beacef9779c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d2691c-59df-4877-8a33-54f2006e582e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d2691c-59df-4877-8a33-54f2006e582e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a8a65d-df61-40ac-88c9-f02eb3665c59', 'volume_name': 'volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc557a-c182-4f3e-890f-90157745fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc557a-c182-4f3e-890f-90157745fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb93a42-7129-43ab-9e89-5dfd9114df2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Volume f1a8a65d-df61-40ac-88c9-f02eb3665c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59', 'volume_size': 1}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1405187101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a8a65d-df61-40ac-88c9-f02eb3665c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf4c18d6e32046fe83d03380b30f25c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:07:16Z,use_quota=True,user_id='f79a8f59963c4bb4a624e949355b57c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Creating volume f1a8a65d-df61-40ac-88c9-f02eb3665c59 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:07:16 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:16 devstack quobyte-client[79699]: System call "getlk" of process 85453 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:07:16 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=47, name=volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59 1073741824" returned: 0 in 0.122s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59" returned: 0 in 0.042s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] <== create_volume: return (170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.173s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb93a42-7129-43ab-9e89-5dfd9114df2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943a37fb-2993-46d7-8133-3bee665b1353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Volume volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59 (f1a8a65d-df61-40ac-88c9-f02eb3665c59): created successfully
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943a37fb-2993-46d7-8133-3bee665b1353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Flow 'volume_create_manager' (810c8cef-a023-4913-aefb-dec7cc45170d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:07:16 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1e46aca3-2164-43cb-989e-a7b268cddc64 tempest-AttachSCSIVolumeTestJSON-239790606 None] Created volume successfully.
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Acquiring lock "cinder-26ac305e-abdb-4539-8d3f-81e7fe33554d-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "cinder-26ac305e-abdb-4539-8d3f-81e7fe33554d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:17 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Acquiring lock "cinder-quobyte-26ac305e-abdb-4539-8d3f-81e7fe33554d" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "cinder-quobyte-26ac305e-abdb-4539-8d3f-81e7fe33554d" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50aaaea-384f-4a34-9419-6186a9f89036]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26ac305e-abdb-4539-8d3f-81e7fe33554d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26ac305e-abdb-4539-8d3f-81e7fe33554d" returned: 0 in 0.242s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26ac305e-abdb-4539-8d3f-81e7fe33554d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26ac305e-abdb-4539-8d3f-81e7fe33554d" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "cinder-quobyte-26ac305e-abdb-4539-8d3f-81e7fe33554d" released by "delete_volume" :: held 0.292s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:07:17 devstack cinder-volume[79893]: WARNING cinder.quota [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:07:17 devstack cinder-volume[79893]: WARNING cinder.quota [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Created reservations ['42ecbf0d-3a0e-4560-a86d-74e7e19c9633', 'e50d1e67-1d78-4331-9d7e-0ccb1ce20c21', '50ae1ecd-db16-45dc-a0d9-3c3b71fe2a9c', '995e313b-713b-47d8-b455-aecf53afafe0'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:07:17 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Deleted volume successfully.
Sep 30 20:07:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37ff03b-8d35-4f7e-a749-d65fccc99037 tempest-VolumeRetypeWithoutMigrationTest-1548095153 None] Lock "cinder-26ac305e-abdb-4539-8d3f-81e7fe33554d-delete_volume" released by "delete_volume" :: held 0.485s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:07:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:07:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-a9078453-9b22-4442-89b7-3199acd95529 req-ecab7b53-8cb8-4fcd-9cf2-379e7db7a52f tempest-AttachSCSIVolumeTestJSON-239790606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-a9078453-9b22-4442-89b7-3199acd95529 req-ecab7b53-8cb8-4fcd-9cf2-379e7db7a52f tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:20 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3234c1-05e5-45dc-960f-5ae209709943]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:07:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-a9078453-9b22-4442-89b7-3199acd95529 req-ecab7b53-8cb8-4fcd-9cf2-379e7db7a52f tempest-AttachSCSIVolumeTestJSON-239790606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-a9078453-9b22-4442-89b7-3199acd95529 req-ecab7b53-8cb8-4fcd-9cf2-379e7db7a52f tempest-AttachSCSIVolumeTestJSON-239790606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59" returned: 0 in 0.150s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-a9078453-9b22-4442-89b7-3199acd95529 req-ecab7b53-8cb8-4fcd-9cf2-379e7db7a52f tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.171s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-a9078453-9b22-4442-89b7-3199acd95529 req-ecab7b53-8cb8-4fcd-9cf2-379e7db7a52f tempest-AttachSCSIVolumeTestJSON-239790606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22bb30d3-39f2-4cc6-bbf7-cb65f7eb89ff', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:07:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-a9078453-9b22-4442-89b7-3199acd95529 req-ecab7b53-8cb8-4fcd-9cf2-379e7db7a52f tempest-AttachSCSIVolumeTestJSON-239790606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-a9078453-9b22-4442-89b7-3199acd95529 req-ecab7b53-8cb8-4fcd-9cf2-379e7db7a52f tempest-AttachSCSIVolumeTestJSON-239790606 None] attachment_update completed successfully.
Sep 30 20:07:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:07:30 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=48,cinder:SELECT=53,cinder:DELETE=6,cinder:INSERT=14 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:07:30 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=39,cinder:UPDATE=47,cinder:INSERT=7,cinder:DELETE=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:07:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:07:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:07:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-d8bc04d9-34e7-4124-9b4c-e47c166abc36 req-fd193907-e535-4232-8a51-f9e6b7f7d0f6 tempest-AttachSCSIVolumeTestJSON-239790606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-d8bc04d9-34e7-4124-9b4c-e47c166abc36 req-fd193907-e535-4232-8a51-f9e6b7f7d0f6 tempest-AttachSCSIVolumeTestJSON-239790606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-d8bc04d9-34e7-4124-9b4c-e47c166abc36 req-fd193907-e535-4232-8a51-f9e6b7f7d0f6 tempest-AttachSCSIVolumeTestJSON-239790606 None] Terminate volume connection completed successfully.
Sep 30 20:07:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-d8bc04d9-34e7-4124-9b4c-e47c166abc36 req-fd193907-e535-4232-8a51-f9e6b7f7d0f6 tempest-AttachSCSIVolumeTestJSON-239790606 None] Deleting attachment 22bb30d3-39f2-4cc6-bbf7-cb65f7eb89ff. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:07:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.069s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:07:55 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (fb1d45a5-d84a-40f2-86c6-4f885035e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99631e0-c357-4142-b350-4a4959c18c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99631e0-c357-4142-b350-4a4959c18c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-473070990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8076461e-148e-4aad-8f11-24fcdcf90db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:07:55Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d45c76-3983-4220-8a25-7d5a3bb4f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d45c76-3983-4220-8a25-7d5a3bb4f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda0778c-bffa-4b67-b5fe-87e625337cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda0778c-bffa-4b67-b5fe-87e625337cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8076461e-148e-4aad-8f11-24fcdcf90db9', 'volume_name': 'volume-8076461e-148e-4aad-8f11-24fcdcf90db9', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05180f7c-f05c-4654-8240-dae5ca5703b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05180f7c-f05c-4654-8240-dae5ca5703b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e1957-e345-4da4-88d0-e5c8875b725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:55 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Volume 8076461e-148e-4aad-8f11-24fcdcf90db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8076461e-148e-4aad-8f11-24fcdcf90db9', 'volume_size': 1}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-473070990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8076461e-148e-4aad-8f11-24fcdcf90db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:07:55Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Creating volume 8076461e-148e-4aad-8f11-24fcdcf90db9 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:07:55 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8076461e-148e-4aad-8f11-24fcdcf90db9 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:55 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=48, name=volume-8076461e-148e-4aad-8f11-24fcdcf90db9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8076461e-148e-4aad-8f11-24fcdcf90db9 1073741824" returned: 0 in 0.157s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8076461e-148e-4aad-8f11-24fcdcf90db9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8076461e-148e-4aad-8f11-24fcdcf90db9" returned: 0 in 0.036s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] <== create_volume: return (201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.204s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e1957-e345-4da4-88d0-e5c8875b725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8076461e-148e-4aad-8f11-24fcdcf90db9', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2059f9e8-7be5-428e-b83e-5e02bd746733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:07:55 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Volume volume-8076461e-148e-4aad-8f11-24fcdcf90db9 (8076461e-148e-4aad-8f11-24fcdcf90db9): created successfully
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2059f9e8-7be5-428e-b83e-5e02bd746733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:07:55 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (fb1d45a5-d84a-40f2-86c6-4f885035e53d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:07:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0df82ff8-f7cd-44b8-8b52-8721b5f0d293 tempest-VolumesActionsTest-1320407043 None] Created volume successfully.
Sep 30 20:07:56 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a15fd88b-789f-49e1-aad5-aba5f04bc75c tempest-VolumesActionsTest-1320407043 None] Acquiring lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9" by "attach_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:56 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a15fd88b-789f-49e1-aad5-aba5f04bc75c tempest-VolumesActionsTest-1320407043 None] Lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9" acquired by "attach_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:56 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a15fd88b-789f-49e1-aad5-aba5f04bc75c tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:56 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a15fd88b-789f-49e1-aad5-aba5f04bc75c tempest-VolumesActionsTest-1320407043 None] Attaching volume 8076461e-148e-4aad-8f11-24fcdcf90db9 to instance 4c9402ec-4deb-4c13-95ab-670d5b8bd1c6 at mountpoint /dev/vdb on host None.
Sep 30 20:07:56 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a15fd88b-789f-49e1-aad5-aba5f04bc75c tempest-VolumesActionsTest-1320407043 None] Attach volume completed successfully.
Sep 30 20:07:56 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a15fd88b-789f-49e1-aad5-aba5f04bc75c tempest-VolumesActionsTest-1320407043 None] Lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9" released by "attach_volume" :: held 0.078s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:07:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:07:57 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Terminate volume connection completed successfully.
Sep 30 20:07:57 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-detach_volume" by "detach_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:57 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:57 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Detaching volume 8076461e-148e-4aad-8f11-24fcdcf90db9 from instance 4c9402ec-4deb-4c13-95ab-670d5b8bd1c6.
Sep 30 20:07:57 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Detach volume completed successfully.
Sep 30 20:07:57 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57e7aae7-398c-491b-9a46-7a126bb9d57b tempest-VolumesActionsTest-621244158 None] Lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Acquiring lock "cinder-f1a8a65d-df61-40ac-88c9-f02eb3665c59-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "cinder-f1a8a65d-df61-40ac-88c9-f02eb3665c59-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Acquiring lock "cinder-quobyte-f1a8a65d-df61-40ac-88c9-f02eb3665c59" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "cinder-quobyte-f1a8a65d-df61-40ac-88c9-f02eb3665c59" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[64498a83-156c-45ad-86c9-25394c2058dc]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59" returned: 0 in 0.134s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f1a8a65d-df61-40ac-88c9-f02eb3665c59" returned: 0 in 0.030s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "cinder-quobyte-f1a8a65d-df61-40ac-88c9-f02eb3665c59" released by "delete_volume" :: held 0.217s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Created reservations ['1133ee4b-1849-406a-bac3-b2cdf458f830', 'f9459cfd-ad6c-43ff-b806-8800bea378d5', '06e49996-6381-4763-a8a3-0d49bd0b1537', 'c9a6e3b8-8989-404f-b2ce-f408d35a5a3b'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c220c905-3928-4a90-a666-bc842269acd9 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-detach_volume" by "detach_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c220c905-3928-4a90-a666-bc842269acd9 tempest-VolumesActionsTest-1320407043 None] Lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c220c905-3928-4a90-a666-bc842269acd9 tempest-VolumesActionsTest-1320407043 None] Volume detach called, but volume not attached.
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c220c905-3928-4a90-a666-bc842269acd9 tempest-VolumesActionsTest-1320407043 None] Lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-detach_volume" released by "detach_volume" :: held 0.034s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.048s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:07:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Deleted volume successfully.
Sep 30 20:07:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-81ce4437-0983-4842-8e8d-88f2569d7c04 tempest-AttachSCSIVolumeTestJSON-239790606 None] Lock "cinder-f1a8a65d-df61-40ac-88c9-f02eb3665c59-delete_volume" released by "delete_volume" :: held 0.471s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Acquiring lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:59 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Acquiring lock "cinder-quobyte-8076461e-148e-4aad-8f11-24fcdcf90db9" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Lock "cinder-quobyte-8076461e-148e-4aad-8f11-24fcdcf90db9" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdfb60-0275-4fb5-8ca0-adecb5d6d614]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8076461e-148e-4aad-8f11-24fcdcf90db9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8076461e-148e-4aad-8f11-24fcdcf90db9" returned: 0 in 0.143s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8076461e-148e-4aad-8f11-24fcdcf90db9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8076461e-148e-4aad-8f11-24fcdcf90db9" returned: 0 in 0.030s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Lock "cinder-quobyte-8076461e-148e-4aad-8f11-24fcdcf90db9" released by "delete_volume" :: held 0.209s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Created reservations ['c0184151-6a57-4890-ae63-d7fd3b106174', 'b0c85854-3b29-4aa0-a377-a254025b790e', 'b892c8f5-87cf-47de-844e-888c996e5d3e', '8529f1eb-2c57-4c38-bbd7-5c9847763fc4'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:07:59 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Deleted volume successfully.
Sep 30 20:07:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5947468c-92b4-447e-b8ca-ca3f041b0b4d tempest-VolumesActionsTest-1320407043 None] Lock "cinder-8076461e-148e-4aad-8f11-24fcdcf90db9-delete_volume" released by "delete_volume" :: held 0.404s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:08:07 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (4642cf13-8c95-4033-bb5d-42f521b07d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26bd4d1-fd3d-4ac0-9b2f-cc8078474e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26bd4d1-fd3d-4ac0-9b2f-cc8078474e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1852214994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa58e18-f6ee-4652-978d-df9dce62ff24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:08Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca7b8bc-c7ec-4c96-809d-ee71b86926a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca7b8bc-c7ec-4c96-809d-ee71b86926a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087d7d0a-0ec0-4283-9059-c2c2097f5ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087d7d0a-0ec0-4283-9059-c2c2097f5ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa58e18-f6ee-4652-978d-df9dce62ff24', 'volume_name': 'volume-ffa58e18-f6ee-4652-978d-df9dce62ff24', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33794e7e-f44b-46f8-aac0-b86cd58895fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33794e7e-f44b-46f8-aac0-b86cd58895fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffccf37d-461a-44be-9ffa-8a0a55ab0064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:07 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Volume ffa58e18-f6ee-4652-978d-df9dce62ff24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa58e18-f6ee-4652-978d-df9dce62ff24', 'volume_size': 1}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1852214994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa58e18-f6ee-4652-978d-df9dce62ff24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:08Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Creating volume ffa58e18-f6ee-4652-978d-df9dce62ff24 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:07 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ffa58e18-f6ee-4652-978d-df9dce62ff24 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:07 devstack quobyte-client[79699]: System call "lookup" of process 85900 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:07 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=49, name=volume-ffa58e18-f6ee-4652-978d-df9dce62ff24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ffa58e18-f6ee-4652-978d-df9dce62ff24 1073741824" returned: 0 in 0.247s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ffa58e18-f6ee-4652-978d-df9dce62ff24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ffa58e18-f6ee-4652-978d-df9dce62ff24" returned: 0 in 0.038s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] <== create_volume: return (304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.307s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffccf37d-461a-44be-9ffa-8a0a55ab0064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa58e18-f6ee-4652-978d-df9dce62ff24', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b34983-da3f-40bd-9f00-7062158c481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:08 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Volume volume-ffa58e18-f6ee-4652-978d-df9dce62ff24 (ffa58e18-f6ee-4652-978d-df9dce62ff24): created successfully
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b34983-da3f-40bd-9f00-7062158c481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (4642cf13-8c95-4033-bb5d-42f521b07d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:08 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5c289644-47e8-4261-acd1-7b9025d8950f tempest-VolumesActionsTest-1320407043 None] Created volume successfully.
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-ffa58e18-f6ee-4652-978d-df9dce62ff24-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Lock "cinder-ffa58e18-f6ee-4652-978d-df9dce62ff24-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:09 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-quobyte-ffa58e18-f6ee-4652-978d-df9dce62ff24" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Lock "cinder-quobyte-ffa58e18-f6ee-4652-978d-df9dce62ff24" acquired by "delete_volume" :: waited 0.023s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5f588d-7879-479f-8f10-fc034cd1ae14]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ffa58e18-f6ee-4652-978d-df9dce62ff24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:09 devstack quobyte-client[79699]: System call "statfs" of process 85977 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ffa58e18-f6ee-4652-978d-df9dce62ff24" returned: 0 in 0.279s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ffa58e18-f6ee-4652-978d-df9dce62ff24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ffa58e18-f6ee-4652-978d-df9dce62ff24" returned: 0 in 0.056s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Lock "cinder-quobyte-ffa58e18-f6ee-4652-978d-df9dce62ff24" released by "delete_volume" :: held 0.391s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Created reservations ['523dfd07-db64-4514-a73a-fd71f960eef5', '1dee4dcb-711d-410b-9cdf-8bddf80436ec', 'd07bc81f-1c33-49af-86be-f58f6349148a', 'f2ce73c7-6b69-40f5-ae31-9f5230cacd25'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.052s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:09 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:09 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Deleted volume successfully.
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-458917c2-8443-43a3-8f74-897be2fa8743 tempest-VolumesActionsTest-621244158 None] Lock "cinder-ffa58e18-f6ee-4652-978d-df9dce62ff24-delete_volume" released by "delete_volume" :: held 0.883s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:10 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (2b44a469-1784-484e-831f-759c63b8d2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827c5fbc-9d78-4230-957d-810d64572277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827c5fbc-9d78-4230-957d-810d64572277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-299556696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bb714a-a17c-46e6-aba0-0c17c291798c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:11Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebc218a-c7fb-4421-a2d2-c94aaa91d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ebc218a-c7fb-4421-a2d2-c94aaa91d533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1695ff-5f6b-4add-b1fa-683afe41930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1695ff-5f6b-4add-b1fa-683afe41930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05bb714a-a17c-46e6-aba0-0c17c291798c', 'volume_name': 'volume-05bb714a-a17c-46e6-aba0-0c17c291798c', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc76ff10-0b49-480f-b1a6-7ca45ed1af94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc76ff10-0b49-480f-b1a6-7ca45ed1af94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fffd6c1-f899-43ad-88da-55de40957235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:10 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Volume 05bb714a-a17c-46e6-aba0-0c17c291798c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05bb714a-a17c-46e6-aba0-0c17c291798c', 'volume_size': 1}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-299556696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bb714a-a17c-46e6-aba0-0c17c291798c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:11Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Creating volume 05bb714a-a17c-46e6-aba0-0c17c291798c {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:10 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05bb714a-a17c-46e6-aba0-0c17c291798c 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:11 devstack quobyte-client[79699]: System call "lookup" of process 85983 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:11 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=50, name=volume-05bb714a-a17c-46e6-aba0-0c17c291798c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-125f110c-a3af-4688-8129-5f434bd075dc req-e60f8981-3e2c-4c3d-94af-445afd879ef6 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05bb714a-a17c-46e6-aba0-0c17c291798c 1073741824" returned: 0 in 0.423s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05bb714a-a17c-46e6-aba0-0c17c291798c {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05bb714a-a17c-46e6-aba0-0c17c291798c" returned: 0 in 0.038s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] <== create_volume: return (482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.484s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-125f110c-a3af-4688-8129-5f434bd075dc req-e60f8981-3e2c-4c3d-94af-445afd879ef6 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.063s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fffd6c1-f899-43ad-88da-55de40957235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bb714a-a17c-46e6-aba0-0c17c291798c', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5066e84-c4ea-49cf-8f63-711ae0e48039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad1b799-f226-4527-abe3-c32651dadd75]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-125f110c-a3af-4688-8129-5f434bd075dc req-e60f8981-3e2c-4c3d-94af-445afd879ef6 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:11 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Volume volume-05bb714a-a17c-46e6-aba0-0c17c291798c (05bb714a-a17c-46e6-aba0-0c17c291798c): created successfully
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5066e84-c4ea-49cf-8f63-711ae0e48039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (2b44a469-1784-484e-831f-759c63b8d2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:11 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f970af8f-e716-4b1e-91b6-05922e1231e0 tempest-VolumesActionsTest-1320407043 None] Created volume successfully.
Sep 30 20:08:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-125f110c-a3af-4688-8129-5f434bd075dc req-e60f8981-3e2c-4c3d-94af-445afd879ef6 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf" returned: 0 in 0.207s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-125f110c-a3af-4688-8129-5f434bd075dc req-e60f8981-3e2c-4c3d-94af-445afd879ef6 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.235s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-125f110c-a3af-4688-8129-5f434bd075dc req-e60f8981-3e2c-4c3d-94af-445afd879ef6 tempest-TestInstancesWithCinderVolumes-169740844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ce4dec1-470f-4555-ae41-d5e0847cd520', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:08:11 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-125f110c-a3af-4688-8129-5f434bd075dc req-e60f8981-3e2c-4c3d-94af-445afd879ef6 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:11 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-125f110c-a3af-4688-8129-5f434bd075dc req-e60f8981-3e2c-4c3d-94af-445afd879ef6 tempest-TestInstancesWithCinderVolumes-169740844 None] attachment_update completed successfully.
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-05bb714a-a17c-46e6-aba0-0c17c291798c-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Lock "cinder-05bb714a-a17c-46e6-aba0-0c17c291798c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:12 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-quobyte-05bb714a-a17c-46e6-aba0-0c17c291798c" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Lock "cinder-quobyte-05bb714a-a17c-46e6-aba0-0c17c291798c" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a632661-5f1a-4772-95a3-b6684295959a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05bb714a-a17c-46e6-aba0-0c17c291798c {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05bb714a-a17c-46e6-aba0-0c17c291798c" returned: 0 in 0.239s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05bb714a-a17c-46e6-aba0-0c17c291798c {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05bb714a-a17c-46e6-aba0-0c17c291798c" returned: 0 in 0.046s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Lock "cinder-quobyte-05bb714a-a17c-46e6-aba0-0c17c291798c" released by "delete_volume" :: held 0.331s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Created reservations ['eb10991a-9f76-4841-8e7f-88bc135e45f3', '298d7522-2164-4b83-a0f1-4e15d624baea', '1649f839-5200-45ed-ac2e-3a4c4f53fda5', 'aea5cf74-26d5-44f0-9384-480ce94b3213'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.036s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:12 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Deleted volume successfully.
Sep 30 20:08:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bff237e6-9ce2-4082-a747-412dd40095d0 tempest-VolumesActionsTest-621244158 None] Lock "cinder-05bb714a-a17c-46e6-aba0-0c17c291798c-delete_volume" released by "delete_volume" :: held 0.544s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:13 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (667cb8fe-f1f6-451e-997d-c62a1dc1f399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44468de7-f07d-49e1-8173-7de9bc0bed8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44468de7-f07d-49e1-8173-7de9bc0bed8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23420450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302b187d-dc40-4560-ba5e-f77c92a81943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:14Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0a297b-413b-492c-bd12-e42918235e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0a297b-413b-492c-bd12-e42918235e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067f3b58-8c10-4546-8f41-0c0c5d54943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067f3b58-8c10-4546-8f41-0c0c5d54943c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302b187d-dc40-4560-ba5e-f77c92a81943', 'volume_name': 'volume-302b187d-dc40-4560-ba5e-f77c92a81943', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af97a16d-1cb8-431d-abbc-d0eeb04942ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af97a16d-1cb8-431d-abbc-d0eeb04942ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ce4ce6-7476-490b-b1d2-fe20f0fdb895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:13 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Volume 302b187d-dc40-4560-ba5e-f77c92a81943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302b187d-dc40-4560-ba5e-f77c92a81943', 'volume_size': 1}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23420450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302b187d-dc40-4560-ba5e-f77c92a81943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:14Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Creating volume 302b187d-dc40-4560-ba5e-f77c92a81943 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:13 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-302b187d-dc40-4560-ba5e-f77c92a81943 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:13 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=51, name=volume-302b187d-dc40-4560-ba5e-f77c92a81943, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-302b187d-dc40-4560-ba5e-f77c92a81943 1073741824" returned: 0 in 0.299s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-302b187d-dc40-4560-ba5e-f77c92a81943 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-302b187d-dc40-4560-ba5e-f77c92a81943" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] <== create_volume: return (348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.354s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ce4ce6-7476-490b-b1d2-fe20f0fdb895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302b187d-dc40-4560-ba5e-f77c92a81943', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f499ff6-feac-47f1-9ea5-31b0e004ffad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:14 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Volume volume-302b187d-dc40-4560-ba5e-f77c92a81943 (302b187d-dc40-4560-ba5e-f77c92a81943): created successfully
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f499ff6-feac-47f1-9ea5-31b0e004ffad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (667cb8fe-f1f6-451e-997d-c62a1dc1f399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:14 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-24bdaaa6-5465-4c93-a496-45ba88fc7693 tempest-VolumesActionsTest-1320407043 None] Created volume successfully.
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-302b187d-dc40-4560-ba5e-f77c92a81943-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Lock "cinder-302b187d-dc40-4560-ba5e-f77c92a81943-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:14 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-quobyte-302b187d-dc40-4560-ba5e-f77c92a81943" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Lock "cinder-quobyte-302b187d-dc40-4560-ba5e-f77c92a81943" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e215af1-72ee-4cd0-a259-1c4ad257d2cc]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-302b187d-dc40-4560-ba5e-f77c92a81943 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-302b187d-dc40-4560-ba5e-f77c92a81943" returned: 0 in 0.163s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-302b187d-dc40-4560-ba5e-f77c92a81943 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-302b187d-dc40-4560-ba5e-f77c92a81943" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Lock "cinder-quobyte-302b187d-dc40-4560-ba5e-f77c92a81943" released by "delete_volume" :: held 0.216s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Created reservations ['5f8087c7-593f-47e8-abf7-f51ab4e2528e', '64828567-0e64-4aeb-aba3-c1243df0872b', '6256d019-250b-4047-a59f-3ec0d100c0bb', '94e5239a-bdf6-4827-9a72-f5dfbb1a8974'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:15 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Deleted volume successfully.
Sep 30 20:08:15 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b3165f3b-d414-4e5e-9656-081ed7ffbfd9 tempest-VolumesActionsTest-621244158 None] Lock "cinder-302b187d-dc40-4560-ba5e-f77c92a81943-delete_volume" released by "delete_volume" :: held 0.447s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:16 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (fa2fb272-5593-4544-9d6e-7e744474a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34128244-8696-4388-b2d1-8eeda4ed2083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34128244-8696-4388-b2d1-8eeda4ed2083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-364611337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20726228-aaf7-488c-b197-d9653c8438a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:16Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fc2520-c2df-4008-9b8e-67d330ea454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fc2520-c2df-4008-9b8e-67d330ea454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6028981d-eb4d-4ba6-8b49-b2bae0cff70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6028981d-eb4d-4ba6-8b49-b2bae0cff70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20726228-aaf7-488c-b197-d9653c8438a8', 'volume_name': 'volume-20726228-aaf7-488c-b197-d9653c8438a8', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0cec90-f61d-4b60-8a23-b3677b2882c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0cec90-f61d-4b60-8a23-b3677b2882c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f635c17-a72b-4a1f-964e-f7ec3255b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Volume 20726228-aaf7-488c-b197-d9653c8438a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20726228-aaf7-488c-b197-d9653c8438a8', 'volume_size': 1}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-364611337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20726228-aaf7-488c-b197-d9653c8438a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:16Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Creating volume 20726228-aaf7-488c-b197-d9653c8438a8 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:16 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-20726228-aaf7-488c-b197-d9653c8438a8 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:16 devstack quobyte-client[79699]: System call "getlk" of process 86024 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:16 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=52, name=volume-20726228-aaf7-488c-b197-d9653c8438a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-20726228-aaf7-488c-b197-d9653c8438a8 1073741824" returned: 0 in 0.294s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-20726228-aaf7-488c-b197-d9653c8438a8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-20726228-aaf7-488c-b197-d9653c8438a8" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] <== create_volume: return (337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.339s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f635c17-a72b-4a1f-964e-f7ec3255b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20726228-aaf7-488c-b197-d9653c8438a8', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9ab434-65d0-40fb-a101-e258450e39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Volume volume-20726228-aaf7-488c-b197-d9653c8438a8 (20726228-aaf7-488c-b197-d9653c8438a8): created successfully
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9ab434-65d0-40fb-a101-e258450e39bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (fa2fb272-5593-4544-9d6e-7e744474a875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:16 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d0a3578c-4841-4297-ba52-bc0e56fae7d7 tempest-VolumesActionsTest-1320407043 None] Created volume successfully.
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-20726228-aaf7-488c-b197-d9653c8438a8-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Lock "cinder-20726228-aaf7-488c-b197-d9653c8438a8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:17 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Acquiring lock "cinder-quobyte-20726228-aaf7-488c-b197-d9653c8438a8" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Lock "cinder-quobyte-20726228-aaf7-488c-b197-d9653c8438a8" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ab438c-cbf7-48b7-99d7-e468517fd3f5]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-20726228-aaf7-488c-b197-d9653c8438a8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-20726228-aaf7-488c-b197-d9653c8438a8" returned: 0 in 0.179s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-20726228-aaf7-488c-b197-d9653c8438a8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-20726228-aaf7-488c-b197-d9653c8438a8" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Lock "cinder-quobyte-20726228-aaf7-488c-b197-d9653c8438a8" released by "delete_volume" :: held 0.238s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Created reservations ['d864e1a2-f262-4d42-962d-ee2afa662f7f', 'e7d0e474-f304-497b-960a-c8329b3e5d9b', '1acb9350-5021-43f4-81e5-87070c8225ce', '9b7bfe32-8507-404b-82bc-45ed87976846'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:17 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Deleted volume successfully.
Sep 30 20:08:17 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9e88d191-2951-49f1-9152-97e123d12e5c tempest-VolumesActionsTest-621244158 None] Lock "cinder-20726228-aaf7-488c-b197-d9653c8438a8-delete_volume" released by "delete_volume" :: held 0.448s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:18 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:18 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (425386e7-17f9-4a90-a972-489ac73b4e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f335ad-d064-4d62-b462-db2e6eac0fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f335ad-d064-4d62-b462-db2e6eac0fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302313994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cbba08-840d-4421-8e6f-16f1e48238a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:19Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b73ca6-8055-4ee3-8737-7d735924defc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b73ca6-8055-4ee3-8737-7d735924defc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ef15f2-963b-4c8f-93c3-6290b1537c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ef15f2-963b-4c8f-93c3-6290b1537c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cbba08-840d-4421-8e6f-16f1e48238a9', 'volume_name': 'volume-f6cbba08-840d-4421-8e6f-16f1e48238a9', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75baf9f7-854d-4387-895f-83938928d95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75baf9f7-854d-4387-895f-83938928d95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231e256e-8abb-40ea-b06b-fc6a8f0c5988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:19 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Volume f6cbba08-840d-4421-8e6f-16f1e48238a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cbba08-840d-4421-8e6f-16f1e48238a9', 'volume_size': 1}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302313994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cbba08-840d-4421-8e6f-16f1e48238a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f08aebc9e4d8da133360613f02de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:19Z,use_quota=True,user_id='b9b264997ccb4655ab2992b63378476f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Creating volume f6cbba08-840d-4421-8e6f-16f1e48238a9 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:19 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f6cbba08-840d-4421-8e6f-16f1e48238a9 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:19 devstack quobyte-client[79699]: System call "getlk" of process 86042 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:08:19 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=53, name=volume-f6cbba08-840d-4421-8e6f-16f1e48238a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f6cbba08-840d-4421-8e6f-16f1e48238a9 1073741824" returned: 0 in 0.176s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f6cbba08-840d-4421-8e6f-16f1e48238a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f6cbba08-840d-4421-8e6f-16f1e48238a9" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] <== create_volume: return (216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.219s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231e256e-8abb-40ea-b06b-fc6a8f0c5988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cbba08-840d-4421-8e6f-16f1e48238a9', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b24e6a4-11ec-42a3-9fbe-8e4e25bd1938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:19 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Volume volume-f6cbba08-840d-4421-8e6f-16f1e48238a9 (f6cbba08-840d-4421-8e6f-16f1e48238a9): created successfully
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b24e6a4-11ec-42a3-9fbe-8e4e25bd1938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Flow 'volume_create_manager' (425386e7-17f9-4a90-a972-489ac73b4e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:19 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0fd2383a-e559-4532-b81c-d6a298f2d2bd tempest-VolumesActionsTest-1320407043 None] Created volume successfully.
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-8f7c46f4-0583-4707-af1e-7c85978519be req-cb6c5cc7-5ed8-4d03-bbbd-35e0b389bc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-8f7c46f4-0583-4707-af1e-7c85978519be req-cb6c5cc7-5ed8-4d03-bbbd-35e0b389bc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[749807e6-e5dc-4e2e-98e3-4d18deead41b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f7c46f4-0583-4707-af1e-7c85978519be req-cb6c5cc7-5ed8-4d03-bbbd-35e0b389bc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-8f7c46f4-0583-4707-af1e-7c85978519be req-cb6c5cc7-5ed8-4d03-bbbd-35e0b389bc7d tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3" returned: 0 in 0.194s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-8f7c46f4-0583-4707-af1e-7c85978519be req-cb6c5cc7-5ed8-4d03-bbbd-35e0b389bc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.206s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-8f7c46f4-0583-4707-af1e-7c85978519be req-cb6c5cc7-5ed8-4d03-bbbd-35e0b389bc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-a51a0ada-4577-4822-939a-3ba4beed30f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9338d0a-f7b1-4a54-a0f9-04332eb1558c', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:08:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-8f7c46f4-0583-4707-af1e-7c85978519be req-cb6c5cc7-5ed8-4d03-bbbd-35e0b389bc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-8f7c46f4-0583-4707-af1e-7c85978519be req-cb6c5cc7-5ed8-4d03-bbbd-35e0b389bc7d tempest-TestInstancesWithCinderVolumes-169740844 None] attachment_update completed successfully.
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Acquiring lock "cinder-f6cbba08-840d-4421-8e6f-16f1e48238a9-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Lock "cinder-f6cbba08-840d-4421-8e6f-16f1e48238a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Acquiring lock "cinder-quobyte-f6cbba08-840d-4421-8e6f-16f1e48238a9" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Lock "cinder-quobyte-f6cbba08-840d-4421-8e6f-16f1e48238a9" acquired by "delete_volume" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b820f60-dcf1-4eeb-b1b7-2ca1f6382935]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f6cbba08-840d-4421-8e6f-16f1e48238a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:20 devstack quobyte-client[79699]: System call "open" of process 86057 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f6cbba08-840d-4421-8e6f-16f1e48238a9" returned: 0 in 0.193s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f6cbba08-840d-4421-8e6f-16f1e48238a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f6cbba08-840d-4421-8e6f-16f1e48238a9" returned: 0 in 0.050s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Lock "cinder-quobyte-f6cbba08-840d-4421-8e6f-16f1e48238a9" released by "delete_volume" :: held 0.264s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Created reservations ['ceb4adff-b764-4e2e-bd36-94bcd67335de', '6c874c79-9e53-411e-9234-6f79aff478fc', '1ce14a13-2b56-4332-a4d7-7b8955c87501', 'aa7f072b-9663-43cf-988d-f23247f71499'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.036s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Deleted volume successfully.
Sep 30 20:08:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6a7811d2-f891-44e2-befe-b3ecbbdd7c1d tempest-VolumesActionsTest-1320407043 None] Lock "cinder-f6cbba08-840d-4421-8e6f-16f1e48238a9-delete_volume" released by "delete_volume" :: held 0.441s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:08:30 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=62,cinder:UPDATE=82,cinder:DELETE=5,cinder:INSERT=18 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:08:30 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=59,cinder:UPDATE=67,cinder:INSERT=12,cinder:DELETE=8 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:08:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:08:35 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Flow 'volume_create_manager' (761ad658-26b3-458c-80a4-06df3700fe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5feb37d-98c2-4815-b3ac-00cdeba1b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5feb37d-98c2-4815-b3ac-00cdeba1b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1703750141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b91ed7-e481-4dce-ac10-2d0fc968e4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d164335af3e405099f94e050ca7f2c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:35Z,use_quota=True,user_id='5ddba870c455467bbf88c88566bffa69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e9dfa5-cb11-4e2d-93f6-c1d1762fce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e9dfa5-cb11-4e2d-93f6-c1d1762fce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96275e0-a15f-4955-9e2d-f7246ba79323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96275e0-a15f-4955-9e2d-f7246ba79323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b91ed7-e481-4dce-ac10-2d0fc968e4e4', 'volume_name': 'volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a992ee8f-3692-4f4a-90db-d580e2318fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a992ee8f-3692-4f4a-90db-d580e2318fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aad46e1-e91a-46d8-91ac-3081667e2eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Volume 46b91ed7-e481-4dce-ac10-2d0fc968e4e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4', 'volume_size': 1}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1703750141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b91ed7-e481-4dce-ac10-2d0fc968e4e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d164335af3e405099f94e050ca7f2c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:35Z,use_quota=True,user_id='5ddba870c455467bbf88c88566bffa69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Creating volume 46b91ed7-e481-4dce-ac10-2d0fc968e4e4 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:35 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:35 devstack quobyte-client[79699]: System call "lookup" of process 86123 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:35 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=54, name=volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4 1073741824" returned: 0 in 0.181s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] <== create_volume: return (228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.230s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aad46e1-e91a-46d8-91ac-3081667e2eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d2f282-2e04-4753-95d0-e2c9ef3b7b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Volume volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4 (46b91ed7-e481-4dce-ac10-2d0fc968e4e4): created successfully
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d2f282-2e04-4753-95d0-e2c9ef3b7b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Flow 'volume_create_manager' (761ad658-26b3-458c-80a4-06df3700fe09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8210448b-1534-4f40-9014-170a9d016302 tempest-AbsoluteLimitsTests-1758422990 None] Created volume successfully.
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Acquiring lock "cinder-46b91ed7-e481-4dce-ac10-2d0fc968e4e4-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Lock "cinder-46b91ed7-e481-4dce-ac10-2d0fc968e4e4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:36 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Acquiring lock "cinder-quobyte-46b91ed7-e481-4dce-ac10-2d0fc968e4e4" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Lock "cinder-quobyte-46b91ed7-e481-4dce-ac10-2d0fc968e4e4" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99c447a-de55-426c-a410-e5ce6a2a36a4]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4" returned: 0 in 0.164s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-46b91ed7-e481-4dce-ac10-2d0fc968e4e4" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Lock "cinder-quobyte-46b91ed7-e481-4dce-ac10-2d0fc968e4e4" released by "delete_volume" :: held 0.226s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Created reservations ['64d63799-1332-489f-af26-f73a8c89066a', 'e4912b3b-b35b-4af6-a669-75b297bacd6e', '267e9d16-92f0-4b17-a89d-7e2951ea7296', '121bcb3d-b91f-4380-b7a8-54e8f9586cd4'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:36 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Deleted volume successfully.
Sep 30 20:08:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c09bdb41-038c-41ed-93c8-815b0a4645c4 tempest-AbsoluteLimitsTests-1758422990 None] Lock "cinder-46b91ed7-e481-4dce-ac10-2d0fc968e4e4-delete_volume" released by "delete_volume" :: held 0.410s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Flow 'volume_create_manager' (e3c167da-e124-47da-9514-fe0da9358aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e8617e-4b2c-4194-9eab-9ae5fec7dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e8617e-4b2c-4194-9eab-9ae5fec7dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1499924999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11712598-41ba-4efd-8875-43e80b2261f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289377e1e370487dbd314d3279393eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:41Z,use_quota=True,user_id='5275d1e8068f4d0a940edd6307621821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b949767-50a4-4f45-ac28-26ab29d10cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b949767-50a4-4f45-ac28-26ab29d10cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e805ded-d5bb-426d-814a-731599c29c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e805ded-d5bb-426d-814a-731599c29c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11712598-41ba-4efd-8875-43e80b2261f8', 'volume_name': 'volume-11712598-41ba-4efd-8875-43e80b2261f8', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7950cc0-7500-45db-8932-a61b7411c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7950cc0-7500-45db-8932-a61b7411c023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc32e23-a76f-4754-8f8e-e4b40f17654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:40 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Volume 11712598-41ba-4efd-8875-43e80b2261f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11712598-41ba-4efd-8875-43e80b2261f8', 'volume_size': 1}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1499924999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11712598-41ba-4efd-8875-43e80b2261f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289377e1e370487dbd314d3279393eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:41Z,use_quota=True,user_id='5275d1e8068f4d0a940edd6307621821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Creating volume 11712598-41ba-4efd-8875-43e80b2261f8 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:40 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11712598-41ba-4efd-8875-43e80b2261f8 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:41 devstack quobyte-client[79699]: System call "ioctl" of process 86136 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:41 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=55, name=volume-11712598-41ba-4efd-8875-43e80b2261f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11712598-41ba-4efd-8875-43e80b2261f8 1073741824" returned: 0 in 0.163s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11712598-41ba-4efd-8875-43e80b2261f8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11712598-41ba-4efd-8875-43e80b2261f8" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] <== create_volume: return (191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.194s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc32e23-a76f-4754-8f8e-e4b40f17654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11712598-41ba-4efd-8875-43e80b2261f8', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa03d153-87b6-4e84-83f9-118bc3b58410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:41 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Volume volume-11712598-41ba-4efd-8875-43e80b2261f8 (11712598-41ba-4efd-8875-43e80b2261f8): created successfully
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa03d153-87b6-4e84-83f9-118bc3b58410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Flow 'volume_create_manager' (e3c167da-e124-47da-9514-fe0da9358aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:41 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-51fa5f77-9de7-494b-8385-cd879745baca tempest-VolumesTransfersV357Test-1495321458 None] Created volume successfully.
Sep 30 20:08:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:08:42 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5847c9f8-38c1-4da9-b622-999300890e7d tempest-VolumesTransfersV357Test-321717905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5847c9f8-38c1-4da9-b622-999300890e7d tempest-VolumesTransfersV357Test-321717905 None] Transfer volume completed successfully.
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Acquiring lock "cinder-11712598-41ba-4efd-8875-43e80b2261f8-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Lock "cinder-11712598-41ba-4efd-8875-43e80b2261f8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Acquiring lock "cinder-quobyte-11712598-41ba-4efd-8875-43e80b2261f8" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Lock "cinder-quobyte-11712598-41ba-4efd-8875-43e80b2261f8" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a4e173-fb97-42ca-a1f5-75a1fa0aa3c6]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11712598-41ba-4efd-8875-43e80b2261f8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11712598-41ba-4efd-8875-43e80b2261f8" returned: 0 in 0.156s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11712598-41ba-4efd-8875-43e80b2261f8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-11712598-41ba-4efd-8875-43e80b2261f8" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Lock "cinder-quobyte-11712598-41ba-4efd-8875-43e80b2261f8" released by "delete_volume" :: held 0.208s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Created reservations ['8b1b72ba-1747-4114-8cd3-e472b4c619c2', '3870bb53-3d46-47fc-b88b-04743ebfda45', '3a9f5360-e245-46d8-a587-fd27d9d40582', '6579a075-03c0-45d6-bb22-fe642aa06e7e'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Deleted volume successfully.
Sep 30 20:08:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-30d0fb62-461a-44da-b439-a2ddc97b5ca8 tempest-VolumesTransfersV357Test-1532866366 None] Lock "cinder-11712598-41ba-4efd-8875-43e80b2261f8-delete_volume" released by "delete_volume" :: held 0.372s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:44 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Flow 'volume_create_manager' (6ece1c0e-bef8-43b4-9dd8-b4a68ae49e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3d0ff7-f323-4640-a29f-99a7fbc6ed15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca3d0ff7-f323-4640-a29f-99a7fbc6ed15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-963940355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0863f693-d9ef-4429-8875-e42c8305ae65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289377e1e370487dbd314d3279393eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:45Z,use_quota=True,user_id='5275d1e8068f4d0a940edd6307621821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d23ec1b-2f47-469e-ae0c-d7bf5d295a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d23ec1b-2f47-469e-ae0c-d7bf5d295a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844df8f1-5bcb-4a38-b57b-53248a741329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844df8f1-5bcb-4a38-b57b-53248a741329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0863f693-d9ef-4429-8875-e42c8305ae65', 'volume_name': 'volume-0863f693-d9ef-4429-8875-e42c8305ae65', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ad9afc-635b-4671-95bf-634d8278c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ad9afc-635b-4671-95bf-634d8278c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc011e4-f795-4fe9-b963-263b256902d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:44 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Volume 0863f693-d9ef-4429-8875-e42c8305ae65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0863f693-d9ef-4429-8875-e42c8305ae65', 'volume_size': 1}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-963940355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0863f693-d9ef-4429-8875-e42c8305ae65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='289377e1e370487dbd314d3279393eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:45Z,use_quota=True,user_id='5275d1e8068f4d0a940edd6307621821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Creating volume 0863f693-d9ef-4429-8875-e42c8305ae65 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:44 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0863f693-d9ef-4429-8875-e42c8305ae65 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:44 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=56, name=volume-0863f693-d9ef-4429-8875-e42c8305ae65, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0863f693-d9ef-4429-8875-e42c8305ae65 1073741824" returned: 0 in 0.137s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0863f693-d9ef-4429-8875-e42c8305ae65 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0863f693-d9ef-4429-8875-e42c8305ae65" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] <== create_volume: return (162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.164s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc011e4-f795-4fe9-b963-263b256902d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0863f693-d9ef-4429-8875-e42c8305ae65', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee48703-5f66-4ca2-9b6f-0dc1b5922649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:45 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Volume volume-0863f693-d9ef-4429-8875-e42c8305ae65 (0863f693-d9ef-4429-8875-e42c8305ae65): created successfully
Sep 30 20:08:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee48703-5f66-4ca2-9b6f-0dc1b5922649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Flow 'volume_create_manager' (6ece1c0e-bef8-43b4-9dd8-b4a68ae49e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:45 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ee86fd89-28d6-43f2-97c0-fc8e0ec78e7e tempest-VolumesTransfersV357Test-1495321458 None] Created volume successfully.
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Acquiring lock "cinder-0863f693-d9ef-4429-8875-e42c8305ae65-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Lock "cinder-0863f693-d9ef-4429-8875-e42c8305ae65-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Acquiring lock "cinder-quobyte-0863f693-d9ef-4429-8875-e42c8305ae65" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Lock "cinder-quobyte-0863f693-d9ef-4429-8875-e42c8305ae65" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfddd754-6356-4cde-b2e4-b213d6588f2a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0863f693-d9ef-4429-8875-e42c8305ae65 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0863f693-d9ef-4429-8875-e42c8305ae65" returned: 0 in 0.151s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0863f693-d9ef-4429-8875-e42c8305ae65 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0863f693-d9ef-4429-8875-e42c8305ae65" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Lock "cinder-quobyte-0863f693-d9ef-4429-8875-e42c8305ae65" released by "delete_volume" :: held 0.207s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Created reservations ['5b5e5369-4c96-420c-ab0b-8239ef09dc38', '6e6918d1-f70a-4a71-a325-57c0cfeb0152', 'ba74ec7a-e8c0-47b2-be84-6591cd9854e2', 'f863f2cc-809a-4251-abf9-e050cf025f2c'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Deleted volume successfully.
Sep 30 20:08:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d1e24e8-ba81-4243-bf10-66bd12be3d44 tempest-VolumesTransfersV357Test-1532866366 None] Lock "cinder-0863f693-d9ef-4429-8875-e42c8305ae65-delete_volume" released by "delete_volume" :: held 0.358s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:08:51 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Flow 'volume_create_manager' (21072e83-d103-4d72-a5a1-e9885e05c623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99a4523-3e14-494e-a5f4-b0f6bc72d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99a4523-3e14-494e-a5f4-b0f6bc72d689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-612493984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821d5ddd-9a9a-4256-bba8-66f17ff8797e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559e96386fd14aa79176acb4b6796666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:51Z,use_quota=True,user_id='66d3213b02024955ac92defd05757757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cb6bb6-a5ac-4931-a354-20db2ab9fac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17cb6bb6-a5ac-4931-a354-20db2ab9fac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384833b3-c499-4ce0-8fde-9bb2dede8aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (384833b3-c499-4ce0-8fde-9bb2dede8aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821d5ddd-9a9a-4256-bba8-66f17ff8797e', 'volume_name': 'volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e', 'volume_size': 2}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c311eee9-d96e-4605-93b8-0ed4aef94454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c311eee9-d96e-4605-93b8-0ed4aef94454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803faf25-d8ed-4300-a0bc-a2f8a266a0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:51 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Volume 821d5ddd-9a9a-4256-bba8-66f17ff8797e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e', 'volume_size': 2}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-612493984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821d5ddd-9a9a-4256-bba8-66f17ff8797e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559e96386fd14aa79176acb4b6796666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:51Z,use_quota=True,user_id='66d3213b02024955ac92defd05757757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Creating volume 821d5ddd-9a9a-4256-bba8-66f17ff8797e {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:51 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e 2147483648 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:51 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=57, name=volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e 2147483648" returned: 0 in 0.164s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] <== create_volume: return (205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.207s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803faf25-d8ed-4300-a0bc-a2f8a266a0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e', 'volume_size': 2}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66484b54-25e3-4319-bed3-b024d75dcc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:51 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Volume volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e (821d5ddd-9a9a-4256-bba8-66f17ff8797e): created successfully
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66484b54-25e3-4319-bed3-b024d75dcc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:51 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Flow 'volume_create_manager' (21072e83-d103-4d72-a5a1-e9885e05c623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:51 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ec34e4a7-639c-46d0-9078-641eeb42dc2b tempest-VolumesCloneNegativeTest-732362961 None] Created volume successfully.
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Acquiring lock "cinder-821d5ddd-9a9a-4256-bba8-66f17ff8797e-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Lock "cinder-821d5ddd-9a9a-4256-bba8-66f17ff8797e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Flow 'volume_create_manager' (fd80d68e-a3ce-4a51-93c1-2d48c815ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5444db8-f521-481e-aae9-91a787d3844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5444db8-f521-481e-aae9-91a787d3844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-620810712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816fad9d-22f5-45dd-b449-e6792ecbe0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66e8ca912264f0e8153eae48cfe4b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:53Z,use_quota=True,user_id='03904ab83dec41a08a6699ebce62fab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89529752-b852-4821-8b11-30993f1c366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89529752-b852-4821-8b11-30993f1c366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b3dfbf-ecf9-4885-8be7-e4dc0f4d3c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b3dfbf-ecf9-4885-8be7-e4dc0f4d3c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '816fad9d-22f5-45dd-b449-e6792ecbe0bb', 'volume_name': 'volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150b0726-eb1d-4669-8c0a-dd6bed9ec65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (150b0726-eb1d-4669-8c0a-dd6bed9ec65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579d1646-e781-421d-81fe-459a0ff4e8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:52 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Volume 816fad9d-22f5-45dd-b449-e6792ecbe0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb', 'volume_size': 1}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-620810712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816fad9d-22f5-45dd-b449-e6792ecbe0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66e8ca912264f0e8153eae48cfe4b80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:53Z,use_quota=True,user_id='03904ab83dec41a08a6699ebce62fab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Creating volume 816fad9d-22f5-45dd-b449-e6792ecbe0bb {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:52 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Acquiring lock "cinder-quobyte-821d5ddd-9a9a-4256-bba8-66f17ff8797e" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Lock "cinder-quobyte-821d5ddd-9a9a-4256-bba8-66f17ff8797e" acquired by "delete_volume" :: waited 0.027s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:52 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=58, name=volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9a852d-3a5c-4549-a68a-19041ed72203]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb 1073741824" returned: 0 in 0.153s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] <== create_volume: return (195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.197s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579d1646-e781-421d-81fe-459a0ff4e8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5cc568-07e2-4b38-9662-797b538af7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:52 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Volume volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb (816fad9d-22f5-45dd-b449-e6792ecbe0bb): created successfully
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5cc568-07e2-4b38-9662-797b538af7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Flow 'volume_create_manager' (fd80d68e-a3ce-4a51-93c1-2d48c815ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:52 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-9d085504-20b4-4c17-b240-37632248ea85 tempest-VolumesAdminNegativeTest-1247710551 None] Created volume successfully.
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e" returned: 0 in 0.206s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-821d5ddd-9a9a-4256-bba8-66f17ff8797e" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Lock "cinder-quobyte-821d5ddd-9a9a-4256-bba8-66f17ff8797e" released by "delete_volume" :: held 0.245s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Created reservations ['741ec980-c945-44f5-a523-b29e3377991a', 'fd8bdecc-83ea-4028-af6d-671fd095e068', '31b5a130-069f-48db-8dd8-9bc7b74cdc7a', '17a7ae9a-e6f9-48b1-b4df-db3cb8f4d07a'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:53 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Deleted volume successfully.
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e7afa7c6-f732-4bb7-a65a-e666184be6db tempest-VolumesCloneNegativeTest-732362961 None] Lock "cinder-821d5ddd-9a9a-4256-bba8-66f17ff8797e-delete_volume" released by "delete_volume" :: held 0.519s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:53 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-ea30a946-e40f-4d0b-9de7-a9d680745aa2 req-24aa0588-b9b9-48ed-b946-1226067589d0 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:53 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-ea30a946-e40f-4d0b-9de7-a9d680745aa2 req-24aa0588-b9b9-48ed-b946-1226067589d0 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:53 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-ea30a946-e40f-4d0b-9de7-a9d680745aa2 req-24aa0588-b9b9-48ed-b946-1226067589d0 tempest-TestInstancesWithCinderVolumes-169740844 None] Terminate volume connection completed successfully.
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-ea30a946-e40f-4d0b-9de7-a9d680745aa2 req-24aa0588-b9b9-48ed-b946-1226067589d0 tempest-TestInstancesWithCinderVolumes-169740844 None] Deleting attachment 9ce4dec1-470f-4555-ae41-d5e0847cd520. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Acquiring lock "cinder-816fad9d-22f5-45dd-b449-e6792ecbe0bb-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Lock "cinder-816fad9d-22f5-45dd-b449-e6792ecbe0bb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Acquiring lock "cinder-quobyte-816fad9d-22f5-45dd-b449-e6792ecbe0bb" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Lock "cinder-quobyte-816fad9d-22f5-45dd-b449-e6792ecbe0bb" acquired by "delete_volume" :: waited 0.019s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fd794-57c6-4181-b647-d7ac18e24b5d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb" returned: 0 in 0.189s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-816fad9d-22f5-45dd-b449-e6792ecbe0bb" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Lock "cinder-quobyte-816fad9d-22f5-45dd-b449-e6792ecbe0bb" released by "delete_volume" :: held 0.289s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Created reservations ['2f772e67-0fff-40cc-8050-d58411c56c1b', '0e2ec913-885f-4bb7-acc9-b1866457c280', 'f21d4f0e-4ac7-4dbf-af95-fef2b3250412', 'd94a97b1-e21d-4d7b-83d0-1c7d7eaa3871'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.036s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Deleted volume successfully.
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4643e201-998e-4781-859f-2a64ed7d236c tempest-VolumesAdminNegativeTest-1247710551 None] Lock "cinder-816fad9d-22f5-45dd-b449-e6792ecbe0bb-delete_volume" released by "delete_volume" :: held 0.514s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "cinder-e13a12e7-9f4f-4388-a197-51a81f7dcccf-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-e13a12e7-9f4f-4388-a197-51a81f7dcccf-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "cinder-quobyte-e13a12e7-9f4f-4388-a197-51a81f7dcccf" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:08:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-quobyte-e13a12e7-9f4f-4388-a197-51a81f7dcccf" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e03700a-4090-48ed-bdab-3f7f1b97fac7]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:55 devstack quobyte-client[79699]: System call "lookup" of process 86285 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:55 devstack quobyte-client[79699]: System call "getattr" of process 86285 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:55 devstack quobyte-client[79699]: System call "open" of process 86285 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf" returned: 0 in 0.237s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-e13a12e7-9f4f-4388-a197-51a81f7dcccf" returned: 0 in 0.081s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-quobyte-e13a12e7-9f4f-4388-a197-51a81f7dcccf" released by "delete_volume" :: held 0.415s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:55 devstack cinder-volume[79893]: WARNING cinder.quota [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2052508336-2031088844 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2052508336-2031088844, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:08:55 devstack cinder-volume[79893]: WARNING cinder.quota [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2052508336-2031088844 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2052508336-2031088844, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Created reservations ['b849ff9b-f53e-404e-87f8-b942562f6ad4', '28d11d92-49bc-456c-be85-81a088b5bd78', '59602653-2e5e-47fe-9d19-3455c2237097', 'd7373a59-4876-417b-92ac-d6e060866735'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.038s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:08:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Deleted volume successfully.
Sep 30 20:08:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ac7fd0c1-b1c9-41f5-a522-9679c024c5e8 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-e13a12e7-9f4f-4388-a197-51a81f7dcccf-delete_volume" released by "delete_volume" :: held 0.726s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:08:56 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:08:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:08:56 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:08:56 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Flow 'volume_create_manager' (5a684247-6d8e-4263-9cc7-8b72306c03f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:08:56 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58afde2-ab33-414c-be3a-25144f6d560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:56 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58afde2-ab33-414c-be3a-25144f6d560b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1764513124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a27f886-8f2b-4c49-bd25-620b5b6970de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91295842ce9475d833be3f0c43a99c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:57Z,use_quota=True,user_id='43b4d682fc3f4c0bb2ff247ee66b796b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:56 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8570fe-a9a2-4ef5-9f5c-06a8f69cf1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:56 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8570fe-a9a2-4ef5-9f5c-06a8f69cf1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:56 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005b30f8-1c55-4b95-bb31-6a408a7b55b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:56 devstack cinder-volume[79893]: DEBUG cinder.image.glance [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Creating Keystone auth plugin from conf {{(pid=79893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005b30f8-1c55-4b95-bb31-6a408a7b55b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a27f886-8f2b-4c49-bd25-620b5b6970de', 'volume_name': 'volume-3a27f886-8f2b-4c49-bd25-620b5b6970de', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733c1d870>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57944da4-8082-419e-b635-df9d4f91b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57944da4-8082-419e-b635-df9d4f91b131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca86fc2-7037-4fa1-9f7a-e544a27b3d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:08:57 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Volume 3a27f886-8f2b-4c49-bd25-620b5b6970de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a27f886-8f2b-4c49-bd25-620b5b6970de', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733c1d870>}
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Cloning 3a27f886-8f2b-4c49-bd25-620b5b6970de from image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]). {{(pid=79893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 20:08:57 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e24756-8f51-47d7-b6ce-e138dde865f4]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:57 devstack sudo[86338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD
Sep 30 20:08:57 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:08:57 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:57 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Temporary image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 is fetched for user 43b4d682fc3f4c0bb2ff247ee66b796b. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09e2a38-e954-47aa-8e98-a76a9a7b9af5]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:58 devstack sudo[86345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD
Sep 30 20:08:58 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:08:58 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1764513124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a27f886-8f2b-4c49-bd25-620b5b6970de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91295842ce9475d833be3f0c43a99c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:08:57Z,use_quota=True,user_id='43b4d682fc3f4c0bb2ff247ee66b796b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Creating volume 3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:08:58 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:58 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=59, name=volume-3a27f886-8f2b-4c49-bd25-620b5b6970de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de 1073741824" returned: 0 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] <== create_volume: return (145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.148s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Attempting download of d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}])) to volume 3a27f886-8f2b-4c49-bd25-620b5b6970de. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b0dd3b-7a23-4cbc-8150-322fe07c7e27]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_fu_c8xgj {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_fu_c8xgj" returned: 0 in 0.122s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_fu_c8xgj {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_fu_c8xgj" returned: 1 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_fu_c8xgj' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f221956-aa67-403d-89f8-7e9f2f475cf5]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD" returned: 0 in 0.122s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 was qcow2, converting to raw {{(pid=79893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:59 devstack quobyte-client[79699]: System call "lookup" of process 86370 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:59 devstack quobyte-client[79699]: System call "getattr" of process 86370 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:59 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=59, name=volume-3a27f886-8f2b-4c49-bd25-620b5b6970de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 0 in 0.379s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_00e3_gjrdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:08:59 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:59 devstack quobyte-client[79699]: System call "getattr" of process 86387 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:59 devstack quobyte-client[79699]: System call "lookup" of process 86387 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:59 devstack quobyte-client[79699]: System call "getattr" of process 86387 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:59 devstack quobyte-client[79699]: System call "open" of process 86387 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de 1G" returned: 0 in 0.066s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8326c5ec-730e-4d44-bd52-e956106fee47]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:08:59 devstack quobyte-client[79699]: System call "open" of process 86390 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 0 in 0.173s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:08:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 1 in 0.160s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Downloaded image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}])) to volume 3a27f886-8f2b-4c49-bd25-620b5b6970de successfully. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Temporary image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 for user 43b4d682fc3f4c0bb2ff247ee66b796b is deleted. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Marking volume 3a27f886-8f2b-4c49-bd25-620b5b6970de as bootable. {{(pid=79893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Copying metadata from image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 to 3a27f886-8f2b-4c49-bd25-620b5b6970de. {{(pid=79893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Creating volume glance metadata for volume 3a27f886-8f2b-4c49-bd25-620b5b6970de backed by image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=79893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca86fc2-7037-4fa1-9f7a-e544a27b3d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a27f886-8f2b-4c49-bd25-620b5b6970de', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733c1d870>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5007bb1-05ca-49f9-a8c8-8c644897c446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:00 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Volume volume-3a27f886-8f2b-4c49-bd25-620b5b6970de (3a27f886-8f2b-4c49-bd25-620b5b6970de): created successfully
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5007bb1-05ca-49f9-a8c8-8c644897c446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Flow 'volume_create_manager' (5a684247-6d8e-4263-9cc7-8b72306c03f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:00 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-09129783-152a-4baa-a258-59b2d932fb4f tempest-VolumesExtendTest-1743573746 None] Created volume successfully.
Sep 30 20:09:00 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017ce6d-9e60-48cf-ba54-5c2816f0bae2]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:01 devstack quobyte-client[79699]: System call "getattr" of process 86397 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 0 in 0.160s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 1 in 0.137s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de 2G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de 2G" returned: 0 in 0.047s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.409s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:01 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b45542c6-a106-4b56-9ad0-0327870e7f0e tempest-VolumesExtendTest-1743573746 None] Extend volume completed successfully.
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Acquiring lock "cinder-3a27f886-8f2b-4c49-bd25-620b5b6970de-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Lock "cinder-3a27f886-8f2b-4c49-bd25-620b5b6970de-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Acquiring lock "cinder-quobyte-3a27f886-8f2b-4c49-bd25-620b5b6970de" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Lock "cinder-quobyte-3a27f886-8f2b-4c49-bd25-620b5b6970de" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a24aa90-1b50-44b1-877e-101c9d7428da]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 0 in 0.140s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:02 devstack quobyte-client[79699]: System call "open" of process 86407 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 1 in 0.174s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3a27f886-8f2b-4c49-bd25-620b5b6970de" returned: 0 in 0.035s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Lock "cinder-quobyte-3a27f886-8f2b-4c49-bd25-620b5b6970de" released by "delete_volume" :: held 0.401s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Created reservations ['df260843-8469-4fae-9e9a-462ae042d34c', 'bdeabd59-06cc-4978-bfe2-c055a19d2b93', '699a4ae8-fb38-4da1-be92-5725af50942e', 'f9feb898-5101-4d5b-865e-942f02f469d8'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:02 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Deleted volume successfully.
Sep 30 20:09:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3ccd2bcd-f9b7-4712-a34f-379c31d0fb84 tempest-VolumesExtendTest-1743573746 None] Lock "cinder-3a27f886-8f2b-4c49-bd25-620b5b6970de-delete_volume" released by "delete_volume" :: held 0.584s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:03 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Flow 'volume_create_manager' (628d7261-acf1-4a55-af73-499de27cab7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f8c297-4830-4864-affb-cac75998e0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f8c297-4830-4864-affb-cac75998e0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-368077895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e62953-5561-4f38-88bf-ce57c854a96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91295842ce9475d833be3f0c43a99c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:04Z,use_quota=True,user_id='43b4d682fc3f4c0bb2ff247ee66b796b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b526b71-6307-4e59-a8b2-a4f42f6bade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b526b71-6307-4e59-a8b2-a4f42f6bade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9108d6-d491-468c-b2ef-96079dec9d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9108d6-d491-468c-b2ef-96079dec9d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e62953-5561-4f38-88bf-ce57c854a96e', 'volume_name': 'volume-05e62953-5561-4f38-88bf-ce57c854a96e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c235b144-9bfe-41a5-9cc6-8d694b549512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c235b144-9bfe-41a5-9cc6-8d694b549512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e54b242-3bca-4ac8-b7f6-beaa6bdb92dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:03 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Volume 05e62953-5561-4f38-88bf-ce57c854a96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e62953-5561-4f38-88bf-ce57c854a96e', 'volume_size': 1}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-368077895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e62953-5561-4f38-88bf-ce57c854a96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b91295842ce9475d833be3f0c43a99c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:04Z,use_quota=True,user_id='43b4d682fc3f4c0bb2ff247ee66b796b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Creating volume 05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:03 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:03 devstack quobyte-client[79699]: System call "lookup" of process 86425 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:03 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=60, name=volume-05e62953-5561-4f38-88bf-ce57c854a96e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e 1073741824" returned: 0 in 0.390s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] <== create_volume: return (439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.441s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e54b242-3bca-4ac8-b7f6-beaa6bdb92dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e62953-5561-4f38-88bf-ce57c854a96e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77006326-1536-4a0e-85fa-9024bf483adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:04 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Volume volume-05e62953-5561-4f38-88bf-ce57c854a96e (05e62953-5561-4f38-88bf-ce57c854a96e): created successfully
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77006326-1536-4a0e-85fa-9024bf483adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Flow 'volume_create_manager' (628d7261-acf1-4a55-af73-499de27cab7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:04 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3fcfbded-3161-4266-ade2-3e52e5e7251f tempest-VolumesExtendTest-1743573746 None] Created volume successfully.
Sep 30 20:09:04 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Creating offline snapshot 9c178f9f-a457-4a9d-981b-c58ac6752955 of volume 05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[47950bdc-e522-4e56-b499-2263669e979c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e" returned: 0 in 0.171s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:04 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=61, name=volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 1G" returned: 0 in 0.121s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img rebase -u -b volume-05e62953-5561-4f38-88bf-ce57c854a96e -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img rebase -u -b volume-05e62953-5561-4f38-88bf-ce57c854a96e -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955" returned: 0 in 0.053s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955" returned: 0 in 0.039s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.info" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.info" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.513s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:05 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-eab5b36b-e864-498c-ab4d-82bb490f55f1 tempest-VolumesExtendTest-1743573746 None] Create snapshot completed successfully
Sep 30 20:09:05 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[288fae1c-9cb6-4d61-9f6c-2d90ec55fb51]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e" returned: 0 in 0.161s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 2G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 2G" returned: 0 in 0.106s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.286s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e6e64c0c-399a-4f52-b31b-c519409eb805 tempest-VolumesExtendTest-1743573746 None] Extend volume completed successfully.
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Acquiring lock "cinder-9c178f9f-a457-4a9d-981b-c58ac6752955-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Lock "cinder-9c178f9f-a457-4a9d-981b-c58ac6752955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:07 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Acquiring lock "cinder-quobyte-05e62953-5561-4f38-88bf-ce57c854a96e" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Lock "cinder-quobyte-05e62953-5561-4f38-88bf-ce57c854a96e" acquired by "delete_snapshot" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Acquiring lock "cinder-quobyte-9c178f9f-a457-4a9d-981b-c58ac6752955" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Lock "cinder-quobyte-9c178f9f-a457-4a9d-981b-c58ac6752955" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Deleting offline snapshot 9c178f9f-a457-4a9d-981b-c58ac6752955 of volume 05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] snapshot_file for this snap is: volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9815516c-f305-4d7a-86ca-93f66b6617be]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955" returned: 0 in 0.138s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05e62953-5561-4f38-88bf-ce57c854a96e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b00fb-8817-4b90-ae5e-0d7625d43bb5]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e" returned: 0 in 0.157s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:07 devstack quobyte-client[79699]: System call "lookup" of process 86484 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:07 devstack quobyte-client[79699]: System call "getattr" of process 86484 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955" returned: 0 in 0.122s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e.9c178f9f-a457-4a9d-981b-c58ac6752955" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Lock "cinder-quobyte-9c178f9f-a457-4a9d-981b-c58ac6752955" released by "_delete_snapshot" :: held 0.518s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Lock "cinder-quobyte-05e62953-5561-4f38-88bf-ce57c854a96e" released by "delete_snapshot" :: held 0.532s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Created reservations ['d8848e68-e86e-4ec7-ad28-83df0ee76f64', '25f9731d-79a5-4ef7-ad36-db245b1ee4c3', '0c9218df-24d7-479b-882e-8c7f0fc35cab', '1eff1a39-f91e-418e-91db-3e8afb911e8f'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:07 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Delete snapshot completed successfully.
Sep 30 20:09:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8112ef9c-da0a-4da7-a25c-c7917916781e tempest-VolumesExtendTest-1743573746 None] Lock "cinder-9c178f9f-a457-4a9d-981b-c58ac6752955-delete_snapshot" released by "delete_snapshot" :: held 0.622s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Acquiring lock "cinder-05e62953-5561-4f38-88bf-ce57c854a96e-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Lock "cinder-05e62953-5561-4f38-88bf-ce57c854a96e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:08 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Acquiring lock "cinder-quobyte-05e62953-5561-4f38-88bf-ce57c854a96e" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Lock "cinder-quobyte-05e62953-5561-4f38-88bf-ce57c854a96e" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[791691b1-2206-4838-84cb-2e588ca3a5eb]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e" returned: 0 in 0.161s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-05e62953-5561-4f38-88bf-ce57c854a96e" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Lock "cinder-quobyte-05e62953-5561-4f38-88bf-ce57c854a96e" released by "delete_volume" :: held 0.222s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Created reservations ['ad3074c7-c6f3-4d35-89f6-90dbb4690ba6', '0aa72bf5-f2fc-4a2d-9ed9-5c45bf360c44', '52e29ba3-585b-496a-be20-c0efe627ed44', '9266b577-d2da-4597-85ed-f8d6a50820b7'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:08 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Deleted volume successfully.
Sep 30 20:09:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b782c605-c5b7-4d95-853a-faac112974a0 tempest-VolumesExtendTest-1743573746 None] Lock "cinder-05e62953-5561-4f38-88bf-ce57c854a96e-delete_volume" released by "delete_volume" :: held 0.406s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:09:13 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Flow 'volume_create_manager' (dce4a3b7-c07e-40b7-9c91-aadb8b649f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f8a65c-9498-49f2-a10d-40bee989e93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f8a65c-9498-49f2-a10d-40bee989e93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-176119291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de5c20c-b07f-44e6-aa86-a2619a3456ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c61be2b10fa542838b137315dd9a9621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:13Z,use_quota=True,user_id='18eea5ab87254990b852bb0da59493a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15097347-8821-4858-a47f-e9d6641734de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15097347-8821-4858-a47f-e9d6641734de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9df0a46-5b8f-4402-b200-2dfcb586fbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9df0a46-5b8f-4402-b200-2dfcb586fbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de5c20c-b07f-44e6-aa86-a2619a3456ee', 'volume_name': 'volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bd1f6e-9cbe-444b-8953-167f6fb338d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bd1f6e-9cbe-444b-8953-167f6fb338d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611767ee-5bdf-4eb2-96c0-32eaa5915426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:13 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Volume 8de5c20c-b07f-44e6-aa86-a2619a3456ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee', 'volume_size': 1}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-176119291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de5c20c-b07f-44e6-aa86-a2619a3456ee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c61be2b10fa542838b137315dd9a9621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:13Z,use_quota=True,user_id='18eea5ab87254990b852bb0da59493a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Creating volume 8de5c20c-b07f-44e6-aa86-a2619a3456ee {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:13 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:13 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=63, name=volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee 1073741824" returned: 0 in 0.150s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee" returned: 0 in 0.043s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] <== create_volume: return (200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.202s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611767ee-5bdf-4eb2-96c0-32eaa5915426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159f67d9-e725-42f2-8897-f949ceffaec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:13 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Volume volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee (8de5c20c-b07f-44e6-aa86-a2619a3456ee): created successfully
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159f67d9-e725-42f2-8897-f949ceffaec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Flow 'volume_create_manager' (dce4a3b7-c07e-40b7-9c91-aadb8b649f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:13 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-546fa5e0-538c-4cec-91ec-6f1f4f66610c tempest-VolumesListTestJSON-414695524 None] Created volume successfully.
Sep 30 20:09:14 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Flow 'volume_create_manager' (80d1889a-75df-419d-a485-ea6134ee05cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eef6d3e-a6e0-44d0-be2a-602a02777b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eef6d3e-a6e0-44d0-be2a-602a02777b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1115336228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac5a5c5-9fb4-400f-a4cc-32e454537f97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c61be2b10fa542838b137315dd9a9621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:15Z,use_quota=True,user_id='18eea5ab87254990b852bb0da59493a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fdce50-dff0-480d-854a-68312566f32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fdce50-dff0-480d-854a-68312566f32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c3b610-ef0d-4f7c-857a-f26654e1334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c3b610-ef0d-4f7c-857a-f26654e1334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac5a5c5-9fb4-400f-a4cc-32e454537f97', 'volume_name': 'volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae05cc95-afd0-4457-91bb-ffbd99f724a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae05cc95-afd0-4457-91bb-ffbd99f724a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ddac41-00d7-467d-a873-a80c687b186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:14 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Volume 4ac5a5c5-9fb4-400f-a4cc-32e454537f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97', 'volume_size': 1}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1115336228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac5a5c5-9fb4-400f-a4cc-32e454537f97,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c61be2b10fa542838b137315dd9a9621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:15Z,use_quota=True,user_id='18eea5ab87254990b852bb0da59493a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Creating volume 4ac5a5c5-9fb4-400f-a4cc-32e454537f97 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:14 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:14 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=64, name=volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:14 devstack quobyte-client[79699]: System call "getattr" of process 86506 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:14 devstack quobyte-client[79699]: System call "open" of process 86506 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97 1073741824" returned: 0 in 0.134s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] <== create_volume: return (166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.169s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ddac41-00d7-467d-a873-a80c687b186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f85f6a-37c3-4685-9234-5166bcfba422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:14 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Volume volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97 (4ac5a5c5-9fb4-400f-a4cc-32e454537f97): created successfully
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f85f6a-37c3-4685-9234-5166bcfba422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:14 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Flow 'volume_create_manager' (80d1889a-75df-419d-a485-ea6134ee05cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:14 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-919f4793-ea53-496e-9874-e017d8051ca4 tempest-VolumesListTestJSON-414695524 None] Created volume successfully.
Sep 30 20:09:15 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Flow 'volume_create_manager' (43ec404d-1883-4e43-886e-3394291f496c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4d3811-eeb0-4bdd-b0d4-73c31149556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4d3811-eeb0-4bdd-b0d4-73c31149556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-720944060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092ac643-9cfd-4f7b-b0a3-6be6ab87bd39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e031928448c464aa8c1300fd8a0b3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:16Z,use_quota=True,user_id='eb239653e8144cec821058b53536a0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb8584a-a6c1-4172-b1ac-1b084fbe6be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb8584a-a6c1-4172-b1ac-1b084fbe6be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190cf9cd-c953-4f27-981b-3c4ce7edb944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190cf9cd-c953-4f27-981b-3c4ce7edb944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '092ac643-9cfd-4f7b-b0a3-6be6ab87bd39', 'volume_name': 'volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf7d80b-2200-4d4d-9f1c-7627cccb3baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf7d80b-2200-4d4d-9f1c-7627cccb3baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5e6097-6c6a-45e8-b9d9-1fb4abee7a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Volume 092ac643-9cfd-4f7b-b0a3-6be6ab87bd39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39', 'volume_size': 1}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-720944060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=092ac643-9cfd-4f7b-b0a3-6be6ab87bd39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e031928448c464aa8c1300fd8a0b3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:16Z,use_quota=True,user_id='eb239653e8144cec821058b53536a0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Creating volume 092ac643-9cfd-4f7b-b0a3-6be6ab87bd39 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:16 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:16 devstack quobyte-client[79699]: System call "lookup" of process 86512 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:16 devstack quobyte-client[79699]: System call "create" of process 86512 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:16 devstack quobyte-client[79699]: System call "getattr" of process 86512 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:16 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=65, name=volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:16 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Flow 'volume_create_manager' (8ec09373-fff1-4768-8aae-7c0202abeaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5af59a-3c9d-4021-a13c-8cf3d485a437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5af59a-3c9d-4021-a13c-8cf3d485a437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-155265692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f0b888-5eea-49d7-bc89-2deb1a815243,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c61be2b10fa542838b137315dd9a9621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:16Z,use_quota=True,user_id='18eea5ab87254990b852bb0da59493a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7c141b-f960-4f6a-9512-255ae215789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7c141b-f960-4f6a-9512-255ae215789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90a669f-4249-40d4-8f30-9bad7bbec6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f90a669f-4249-40d4-8f30-9bad7bbec6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f0b888-5eea-49d7-bc89-2deb1a815243', 'volume_name': 'volume-b2f0b888-5eea-49d7-bc89-2deb1a815243', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0b8d94-ecbf-4e54-95fd-d422ebc766f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e0b8d94-ecbf-4e54-95fd-d422ebc766f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23830887-2d5e-477e-9f6d-e4563e1a382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Volume b2f0b888-5eea-49d7-bc89-2deb1a815243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f0b888-5eea-49d7-bc89-2deb1a815243', 'volume_size': 1}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39 1073741824" returned: 0 in 0.196s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] <== create_volume: return (221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.223s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-155265692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f0b888-5eea-49d7-bc89-2deb1a815243,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c61be2b10fa542838b137315dd9a9621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:16Z,use_quota=True,user_id='18eea5ab87254990b852bb0da59493a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Creating volume b2f0b888-5eea-49d7-bc89-2deb1a815243 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:16 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b2f0b888-5eea-49d7-bc89-2deb1a815243 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5e6097-6c6a-45e8-b9d9-1fb4abee7a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a945454-0347-4474-80ef-fe3b4657d6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Volume volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39 (092ac643-9cfd-4f7b-b0a3-6be6ab87bd39): created successfully
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a945454-0347-4474-80ef-fe3b4657d6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Flow 'volume_create_manager' (43ec404d-1883-4e43-886e-3394291f496c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:16 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=66, name=volume-b2f0b888-5eea-49d7-bc89-2deb1a815243, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:16 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f16327f4-eac1-4752-910c-cd6a8b8d9248 tempest-AttachVolumeTestJSON-143237044 None] Created volume successfully.
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b2f0b888-5eea-49d7-bc89-2deb1a815243 1073741824" returned: 0 in 0.135s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b2f0b888-5eea-49d7-bc89-2deb1a815243 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b2f0b888-5eea-49d7-bc89-2deb1a815243" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] <== create_volume: return (162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.164s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23830887-2d5e-477e-9f6d-e4563e1a382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f0b888-5eea-49d7-bc89-2deb1a815243', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0896951c-806a-4204-ada9-5eaaae6c819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:16 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Volume volume-b2f0b888-5eea-49d7-bc89-2deb1a815243 (b2f0b888-5eea-49d7-bc89-2deb1a815243): created successfully
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0896951c-806a-4204-ada9-5eaaae6c819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:16 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Flow 'volume_create_manager' (8ec09373-fff1-4768-8aae-7c0202abeaf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:16 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8b003865-a3a8-4754-bcf6-4bbdfb0619c3 tempest-VolumesListTestJSON-414695524 None] Created volume successfully.
Sep 30 20:09:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Acquiring lock "cinder-b2f0b888-5eea-49d7-bc89-2deb1a815243-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Lock "cinder-b2f0b888-5eea-49d7-bc89-2deb1a815243-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:19 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Acquiring lock "cinder-quobyte-b2f0b888-5eea-49d7-bc89-2deb1a815243" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Lock "cinder-quobyte-b2f0b888-5eea-49d7-bc89-2deb1a815243" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2ab491-5385-4402-a880-1095b661cc61]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b2f0b888-5eea-49d7-bc89-2deb1a815243 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b2f0b888-5eea-49d7-bc89-2deb1a815243" returned: 0 in 0.179s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b2f0b888-5eea-49d7-bc89-2deb1a815243 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b2f0b888-5eea-49d7-bc89-2deb1a815243" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Lock "cinder-quobyte-b2f0b888-5eea-49d7-bc89-2deb1a815243" released by "delete_volume" :: held 0.239s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Created reservations ['2728543e-dde4-432b-ad04-d8b754d99b17', 'fd0560f7-b595-47ce-bf45-ad61eb8e4f6e', '6a462f7e-fa1f-4072-83ee-6ce32532a5b5', 'b1b85f10-95ee-406b-b80c-fad062cea405'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-22356555-edb6-45b6-b62b-5c5d5d53d047 req-177e10c7-f4f0-41ec-9a35-17a7ac7b547a tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-22356555-edb6-45b6-b62b-5c5d5d53d047 req-177e10c7-f4f0-41ec-9a35-17a7ac7b547a tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed3439a-95d1-49ef-941d-00d74799ab58]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-22356555-edb6-45b6-b62b-5c5d5d53d047 req-177e10c7-f4f0-41ec-9a35-17a7ac7b547a tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:19 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Deleted volume successfully.
Sep 30 20:09:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-935ddad1-457b-4a21-8cfc-6f3cd11c37ac tempest-VolumesListTestJSON-414695524 None] Lock "cinder-b2f0b888-5eea-49d7-bc89-2deb1a815243-delete_volume" released by "delete_volume" :: held 0.407s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-22356555-edb6-45b6-b62b-5c5d5d53d047 req-177e10c7-f4f0-41ec-9a35-17a7ac7b547a tempest-AttachVolumeTestJSON-143237044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39" returned: 0 in 0.154s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-22356555-edb6-45b6-b62b-5c5d5d53d047 req-177e10c7-f4f0-41ec-9a35-17a7ac7b547a tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.175s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-22356555-edb6-45b6-b62b-5c5d5d53d047 req-177e10c7-f4f0-41ec-9a35-17a7ac7b547a tempest-AttachVolumeTestJSON-143237044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd02cee03-611d-406e-a0ba-43a9dd58ba22', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:09:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-22356555-edb6-45b6-b62b-5c5d5d53d047 req-177e10c7-f4f0-41ec-9a35-17a7ac7b547a tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-22356555-edb6-45b6-b62b-5c5d5d53d047 req-177e10c7-f4f0-41ec-9a35-17a7ac7b547a tempest-AttachVolumeTestJSON-143237044 None] attachment_update completed successfully.
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "cinder-4ac5a5c5-9fb4-400f-a4cc-32e454537f97-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Lock "cinder-4ac5a5c5-9fb4-400f-a4cc-32e454537f97-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "cinder-quobyte-4ac5a5c5-9fb4-400f-a4cc-32e454537f97" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Lock "cinder-quobyte-4ac5a5c5-9fb4-400f-a4cc-32e454537f97" acquired by "delete_volume" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[207a654d-b688-4ca0-978a-1005e93d7bfa]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97" returned: 0 in 0.165s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4ac5a5c5-9fb4-400f-a4cc-32e454537f97" returned: 0 in 0.030s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Lock "cinder-quobyte-4ac5a5c5-9fb4-400f-a4cc-32e454537f97" released by "delete_volume" :: held 0.231s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Created reservations ['28627707-58d6-43d4-8aac-258c6fe4f789', '531e0658-4239-4883-afed-6fc6780b2546', '368a9466-418d-4436-b7d6-8fad939347e1', 'b5d24521-fd02-4881-8f74-c78e85388d49'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.042s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:21 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Deleted volume successfully.
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c0182532-b14d-4cd0-83ac-67245f14b078 tempest-VolumesListTestJSON-414695524 None] Lock "cinder-4ac5a5c5-9fb4-400f-a4cc-32e454537f97-delete_volume" released by "delete_volume" :: held 0.441s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "cinder-8de5c20c-b07f-44e6-aa86-a2619a3456ee-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Lock "cinder-8de5c20c-b07f-44e6-aa86-a2619a3456ee-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "cinder-quobyte-8de5c20c-b07f-44e6-aa86-a2619a3456ee" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Lock "cinder-quobyte-8de5c20c-b07f-44e6-aa86-a2619a3456ee" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[69859f88-6190-47c8-88d7-175720a68404]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:22 devstack quobyte-client[79699]: System call "getattr" of process 86555 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee" returned: 0 in 0.171s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8de5c20c-b07f-44e6-aa86-a2619a3456ee" returned: 0 in 0.026s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Lock "cinder-quobyte-8de5c20c-b07f-44e6-aa86-a2619a3456ee" released by "delete_volume" :: held 0.235s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Created reservations ['31a3c54f-cc48-44d5-9b66-b003127d5c71', '2080e86c-902c-4474-bc5d-5c34a9fedcea', 'a571d26f-9a27-4fa7-a268-a9fe3c8c4aaf', 'f70c039e-6aad-477a-9687-88c901407cbf'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:22 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Deleted volume successfully.
Sep 30 20:09:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c70b3dd6-b57f-44fd-86bf-9a973b7da186 tempest-VolumesListTestJSON-414695524 None] Lock "cinder-8de5c20c-b07f-44e6-aa86-a2619a3456ee-delete_volume" released by "delete_volume" :: held 0.438s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:23 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-66a9ef5f-bc2c-4e70-960e-bece80e97f69 req-016942cb-72e7-4347-8871-3a456582375b tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:23 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-66a9ef5f-bc2c-4e70-960e-bece80e97f69 req-016942cb-72e7-4347-8871-3a456582375b tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:23 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-66a9ef5f-bc2c-4e70-960e-bece80e97f69 req-016942cb-72e7-4347-8871-3a456582375b tempest-TestInstancesWithCinderVolumes-169740844 None] Terminate volume connection completed successfully.
Sep 30 20:09:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-66a9ef5f-bc2c-4e70-960e-bece80e97f69 req-016942cb-72e7-4347-8871-3a456582375b tempest-TestInstancesWithCinderVolumes-169740844 None] Deleting attachment c9338d0a-f7b1-4a54-a0f9-04332eb1558c. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "cinder-a51a0ada-4577-4822-939a-3ba4beed30f3-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-a51a0ada-4577-4822-939a-3ba4beed30f3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "cinder-quobyte-a51a0ada-4577-4822-939a-3ba4beed30f3" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-quobyte-a51a0ada-4577-4822-939a-3ba4beed30f3" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[371b447a-e1c3-48fc-9e6f-be9651d21b3b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3" returned: 0 in 0.222s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a51a0ada-4577-4822-939a-3ba4beed30f3" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-quobyte-a51a0ada-4577-4822-939a-3ba4beed30f3" released by "delete_volume" :: held 0.276s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:24 devstack cinder-volume[79893]: WARNING cinder.quota [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-67493379-1731026441 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-67493379-1731026441, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:09:24 devstack cinder-volume[79893]: WARNING cinder.quota [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-67493379-1731026441 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-67493379-1731026441, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Created reservations ['fe1940b5-67e3-49d9-840e-a89a48202c48', '8a56b1c0-f1d2-4ad3-83f6-0880a766a249', '9db2145b-248a-4ffd-acb3-7f6d0e3f4def', '474a6f93-5e68-40e9-b7ca-193f1a35cc90'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:24 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Deleted volume successfully.
Sep 30 20:09:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0eca95d1-216c-47d2-9a33-b936d41b0fc7 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-a51a0ada-4577-4822-939a-3ba4beed30f3-delete_volume" released by "delete_volume" :: held 0.463s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Flow 'volume_create_manager' (7bcfbf75-8bb4-4017-8161-26679097d538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f7a79-ffc7-416b-aa06-42ac99365bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184f7a79-ffc7-416b-aa06-42ac99365bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1145912276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645015c4-656a-43a4-ab7e-e30cb50df14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e031928448c464aa8c1300fd8a0b3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:25Z,use_quota=True,user_id='eb239653e8144cec821058b53536a0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247a56c8-4fed-4fba-aacc-1143e9562dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247a56c8-4fed-4fba-aacc-1143e9562dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c23aa77-da25-4777-9d37-d22cffb4e675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c23aa77-da25-4777-9d37-d22cffb4e675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645015c4-656a-43a4-ab7e-e30cb50df14e', 'volume_name': 'volume-645015c4-656a-43a4-ab7e-e30cb50df14e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e45c69a-1e29-4734-bf8a-69ff1423b7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e45c69a-1e29-4734-bf8a-69ff1423b7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653fc3d6-7830-4aef-8070-a9a7d0d6339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Volume 645015c4-656a-43a4-ab7e-e30cb50df14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645015c4-656a-43a4-ab7e-e30cb50df14e', 'volume_size': 1}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1145912276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645015c4-656a-43a4-ab7e-e30cb50df14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e031928448c464aa8c1300fd8a0b3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:25Z,use_quota=True,user_id='eb239653e8144cec821058b53536a0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Creating volume 645015c4-656a-43a4-ab7e-e30cb50df14e {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:25 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:25 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=67, name=volume-645015c4-656a-43a4-ab7e-e30cb50df14e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e 1073741824" returned: 0 in 0.194s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] <== create_volume: return (230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.232s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653fc3d6-7830-4aef-8070-a9a7d0d6339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645015c4-656a-43a4-ab7e-e30cb50df14e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b33aa2-de44-49dd-9a39-b89a50b79404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Volume volume-645015c4-656a-43a4-ab7e-e30cb50df14e (645015c4-656a-43a4-ab7e-e30cb50df14e): created successfully
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b33aa2-de44-49dd-9a39-b89a50b79404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Flow 'volume_create_manager' (7bcfbf75-8bb4-4017-8161-26679097d538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a90299e9-da53-4c38-85d7-6e222e884264 tempest-AttachVolumeTestJSON-143237044 None] Created volume successfully.
Sep 30 20:09:26 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (c421a544-82a9-486b-b8b3-3b5814095254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342d0f81-eea0-4412-afe6-587cc88b89f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342d0f81-eea0-4412-afe6-587cc88b89f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-326793230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9069db-37a2-49a7-9d14-96815dc8e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:26Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0777fa8c-2728-46fd-94bb-0078dcd1aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0777fa8c-2728-46fd-94bb-0078dcd1aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc0bf56-928a-4ece-8b13-4f3422a83a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc0bf56-928a-4ece-8b13-4f3422a83a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9069db-37a2-49a7-9d14-96815dc8e6b4', 'volume_name': 'volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb00035-a491-4155-a9e2-744a151dafdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb00035-a491-4155-a9e2-744a151dafdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce4c3fa-ef32-4d1a-b399-ae9abd13dd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:26 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume 8e9069db-37a2-49a7-9d14-96815dc8e6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4', 'volume_size': 1}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-326793230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9069db-37a2-49a7-9d14-96815dc8e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:26Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Creating volume 8e9069db-37a2-49a7-9d14-96815dc8e6b4 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:26 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:26 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=68, name=volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4 1073741824" returned: 0 in 0.157s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4" returned: 0 in 0.039s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] <== create_volume: return (204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.206s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce4c3fa-ef32-4d1a-b399-ae9abd13dd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce12b54-8516-4ff2-af91-a6306d00c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:26 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4 (8e9069db-37a2-49a7-9d14-96815dc8e6b4): created successfully
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce12b54-8516-4ff2-af91-a6306d00c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (c421a544-82a9-486b-b8b3-3b5814095254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:26 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a15e18ba-63c7-4e28-b209-78a762069c8a tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created volume successfully.
Sep 30 20:09:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:09:27 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (b5a6b3cb-41b3-4aa8-b3e4-f5b346295cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd4f83a-bdb4-4779-bbf3-08e7006843ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd4f83a-bdb4-4779-bbf3-08e7006843ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364481496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5bdfde-73a8-4f9d-ae43-397c57848512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:27Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ee8d77-cee1-4b1b-bc41-6154d5954af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ee8d77-cee1-4b1b-bc41-6154d5954af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a7d90d-a53a-4a3d-89fd-c855614ef759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a7d90d-a53a-4a3d-89fd-c855614ef759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5bdfde-73a8-4f9d-ae43-397c57848512', 'volume_name': 'volume-ba5bdfde-73a8-4f9d-ae43-397c57848512', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24bdbe1c-579b-4700-a8a3-3a021e91eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24bdbe1c-579b-4700-a8a3-3a021e91eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c2c367-e145-421c-9ed9-ecac2b56fdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume ba5bdfde-73a8-4f9d-ae43-397c57848512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5bdfde-73a8-4f9d-ae43-397c57848512', 'volume_size': 1}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1364481496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5bdfde-73a8-4f9d-ae43-397c57848512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:27Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Creating volume ba5bdfde-73a8-4f9d-ae43-397c57848512 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:27 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ba5bdfde-73a8-4f9d-ae43-397c57848512 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:27 devstack quobyte-client[79699]: System call "getlk" of process 86597 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:27 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=69, name=volume-ba5bdfde-73a8-4f9d-ae43-397c57848512, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ba5bdfde-73a8-4f9d-ae43-397c57848512 1073741824" returned: 0 in 0.194s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ba5bdfde-73a8-4f9d-ae43-397c57848512 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ba5bdfde-73a8-4f9d-ae43-397c57848512" returned: 0 in 0.059s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] <== create_volume: return (264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.267s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c2c367-e145-421c-9ed9-ecac2b56fdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5bdfde-73a8-4f9d-ae43-397c57848512', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d10594-6394-4b9b-9742-5e7e07d07244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (ed0cc907-4f61-47b9-8ebe-1a413f5072fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d5d1a9-9fd1-4039-813f-9c33ab25b7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume volume-ba5bdfde-73a8-4f9d-ae43-397c57848512 (ba5bdfde-73a8-4f9d-ae43-397c57848512): created successfully
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43d10594-6394-4b9b-9742-5e7e07d07244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (b5a6b3cb-41b3-4aa8-b3e4-f5b346295cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:27 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ed7faad5-5098-445b-a0c4-31396ea56610 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created volume successfully.
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d5d1a9-9fd1-4039-813f-9c33ab25b7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-123345446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d071d5-2870-42ca-9466-463184372cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:28Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a209f49-288e-42dd-b21a-bb2b65dbeb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a209f49-288e-42dd-b21a-bb2b65dbeb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95b54d6-088b-46d8-b9a3-38c013d0b415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95b54d6-088b-46d8-b9a3-38c013d0b415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d071d5-2870-42ca-9466-463184372cd0', 'volume_name': 'volume-55d071d5-2870-42ca-9466-463184372cd0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae7545a-67ab-41d8-86a6-e66e5f9603e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae7545a-67ab-41d8-86a6-e66e5f9603e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3fa9b65-3718-4b4b-8c36-5793f93f095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:27 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume 55d071d5-2870-42ca-9466-463184372cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d071d5-2870-42ca-9466-463184372cd0', 'volume_size': 1}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-123345446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d071d5-2870-42ca-9466-463184372cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:28Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Creating volume 55d071d5-2870-42ca-9466-463184372cd0 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-55d071d5-2870-42ca-9466-463184372cd0 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:28 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=70, name=volume-55d071d5-2870-42ca-9466-463184372cd0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (e5487849-be13-434b-952f-47aad719ba63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a0cea4-024d-45a7-a88d-e1bf88aeb1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a0cea4-024d-45a7-a88d-e1bf88aeb1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1127235799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d8f1a7-bac4-4c87-94b2-672f095a1719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:28Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d66931-4638-466b-8a5e-0e1f2f87e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d66931-4638-466b-8a5e-0e1f2f87e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a99ec8-4f0f-4234-bd05-1ac602205548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6a99ec8-4f0f-4234-bd05-1ac602205548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d8f1a7-bac4-4c87-94b2-672f095a1719', 'volume_name': 'volume-76d8f1a7-bac4-4c87-94b2-672f095a1719', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e592c1-f6e5-4589-becc-55e6bc3a7306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e592c1-f6e5-4589-becc-55e6bc3a7306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c457e74-72f6-454e-860a-2656374a1e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume 76d8f1a7-bac4-4c87-94b2-672f095a1719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d8f1a7-bac4-4c87-94b2-672f095a1719', 'volume_size': 1}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-55d071d5-2870-42ca-9466-463184372cd0 1073741824" returned: 0 in 0.182s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-55d071d5-2870-42ca-9466-463184372cd0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-55d071d5-2870-42ca-9466-463184372cd0" returned: 0 in 0.039s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] <== create_volume: return (231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.235s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1127235799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d8f1a7-bac4-4c87-94b2-672f095a1719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:28Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Creating volume 76d8f1a7-bac4-4c87-94b2-672f095a1719 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-76d8f1a7-bac4-4c87-94b2-672f095a1719 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3fa9b65-3718-4b4b-8c36-5793f93f095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d071d5-2870-42ca-9466-463184372cd0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f205f67-3a44-42d2-b1b9-0a39abf984ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume volume-55d071d5-2870-42ca-9466-463184372cd0 (55d071d5-2870-42ca-9466-463184372cd0): created successfully
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f205f67-3a44-42d2-b1b9-0a39abf984ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (ed0cc907-4f61-47b9-8ebe-1a413f5072fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-32e69420-a621-42e9-9fd3-04913347734c tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created volume successfully.
Sep 30 20:09:28 devstack quobyte-client[79699]: System call "create" of process 86619 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:28 devstack quobyte-client[79699]: System call "getattr" of process 86619 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:28 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=71, name=volume-76d8f1a7-bac4-4c87-94b2-672f095a1719, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-76d8f1a7-bac4-4c87-94b2-672f095a1719 1073741824" returned: 0 in 0.232s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-76d8f1a7-bac4-4c87-94b2-672f095a1719 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-76d8f1a7-bac4-4c87-94b2-672f095a1719" returned: 0 in 0.119s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] <== create_volume: return (362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.365s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c457e74-72f6-454e-860a-2656374a1e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d8f1a7-bac4-4c87-94b2-672f095a1719', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a70a65-6fb8-48db-85c7-3b50fbb0e522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (5380f6ff-a7e7-4c3c-8c27-a63ec2f6bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b116b158-8b0c-42e6-be77-a70654465b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume volume-76d8f1a7-bac4-4c87-94b2-672f095a1719 (76d8f1a7-bac4-4c87-94b2-672f095a1719): created successfully
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a70a65-6fb8-48db-85c7-3b50fbb0e522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (e5487849-be13-434b-952f-47aad719ba63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d412cf01-97ff-4d86-87f7-3e81327bc1b6 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created volume successfully.
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b116b158-8b0c-42e6-be77-a70654465b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211375112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47242bdb-b51c-47cc-b7b6-f75566b7934e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:29Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1788a2-707b-4bef-989e-db8043bcaa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1788a2-707b-4bef-989e-db8043bcaa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3a7378-481c-4a96-b21c-6ad51ab199f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f3a7378-481c-4a96-b21c-6ad51ab199f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47242bdb-b51c-47cc-b7b6-f75566b7934e', 'volume_name': 'volume-47242bdb-b51c-47cc-b7b6-f75566b7934e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8283f9dd-d2a9-43ff-bb7e-5ab095d85715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8283f9dd-d2a9-43ff-bb7e-5ab095d85715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbc17bc-1f88-447d-aa8a-7089ab72e289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume 47242bdb-b51c-47cc-b7b6-f75566b7934e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47242bdb-b51c-47cc-b7b6-f75566b7934e', 'volume_size': 1}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211375112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47242bdb-b51c-47cc-b7b6-f75566b7934e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:29Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Creating volume 47242bdb-b51c-47cc-b7b6-f75566b7934e {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-47242bdb-b51c-47cc-b7b6-f75566b7934e 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (0e91282a-4728-49da-8004-8a8268eb2f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:28 devstack quobyte-client[79699]: System call "lookup" of process 86624 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:28 devstack quobyte-client[79699]: System call "create" of process 86624 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14d7384-d490-4ed6-bba1-99cf2bcab39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack quobyte-client[79699]: System call "getattr" of process 86624 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14d7384-d490-4ed6-bba1-99cf2bcab39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601595297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee582640-bdbe-4ac4-904c-6131e8c421f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:29Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=72, name=volume-47242bdb-b51c-47cc-b7b6-f75566b7934e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b767521-4db9-4297-888e-6d59aa39a69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b767521-4db9-4297-888e-6d59aa39a69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4aad3a-ff05-43a8-9030-ecc618a6e3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4aad3a-ff05-43a8-9030-ecc618a6e3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee582640-bdbe-4ac4-904c-6131e8c421f2', 'volume_name': 'volume-ee582640-bdbe-4ac4-904c-6131e8c421f2', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869c2dd5-1059-429a-9e1a-90ee10d68c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869c2dd5-1059-429a-9e1a-90ee10d68c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c044c73-615a-4dc1-81e4-3f05d8299471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume ee582640-bdbe-4ac4-904c-6131e8c421f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee582640-bdbe-4ac4-904c-6131e8c421f2', 'volume_size': 1}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Flow 'volume_create_manager' (82817576-654e-42fd-a348-ce9975a7176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e800ba-e88b-48dd-8b06-8fe5dcaa47df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e800ba-e88b-48dd-8b06-8fe5dcaa47df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1024474848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07271548-fdf0-4933-9ca6-f2794b24e00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540960c1ff3543f8949305464619f0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:29Z,use_quota=True,user_id='2ce7986db6fa40338e7d3faced990fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a289a5-b912-410d-bb7d-6a675deff9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19a289a5-b912-410d-bb7d-6a675deff9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afb824f-10ed-40f8-b290-eec1f66d483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afb824f-10ed-40f8-b290-eec1f66d483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07271548-fdf0-4933-9ca6-f2794b24e00d', 'volume_name': 'volume-07271548-fdf0-4933-9ca6-f2794b24e00d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b162c8-eb3f-464a-9e27-6f02ee435949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b162c8-eb3f-464a-9e27-6f02ee435949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6078b238-97ad-4dcc-a52a-e48985600ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Volume 07271548-fdf0-4933-9ca6-f2794b24e00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07271548-fdf0-4933-9ca6-f2794b24e00d', 'volume_size': 1}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-47242bdb-b51c-47cc-b7b6-f75566b7934e 1073741824" returned: 0 in 0.196s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-47242bdb-b51c-47cc-b7b6-f75566b7934e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-47242bdb-b51c-47cc-b7b6-f75566b7934e" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] <== create_volume: return (224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.226s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.107s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601595297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee582640-bdbe-4ac4-904c-6131e8c421f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d312075a7e2a4b92979acf578c7da930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:29Z,use_quota=True,user_id='d01f7a1ddf3142a5bf4ab7d0e32d6c8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Creating volume ee582640-bdbe-4ac4-904c-6131e8c421f2 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:28 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ee582640-bdbe-4ac4-904c-6131e8c421f2 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbc17bc-1f88-447d-aa8a-7089ab72e289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47242bdb-b51c-47cc-b7b6-f75566b7934e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a2e209-bb0e-479e-838e-ded1e1104e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:29 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume volume-47242bdb-b51c-47cc-b7b6-f75566b7934e (47242bdb-b51c-47cc-b7b6-f75566b7934e): created successfully
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a2e209-bb0e-479e-838e-ded1e1104e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:29 devstack quobyte-client[79699]: System call "ioctl" of process 86628 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:29 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=73, name=volume-ee582640-bdbe-4ac4-904c-6131e8c421f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (5380f6ff-a7e7-4c3c-8c27-a63ec2f6bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-34d7b9f8-a958-4568-b9c5-b4f58c70ef75 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created volume successfully.
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ee582640-bdbe-4ac4-904c-6131e8c421f2 1073741824" returned: 0 in 0.164s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ee582640-bdbe-4ac4-904c-6131e8c421f2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ee582640-bdbe-4ac4-904c-6131e8c421f2" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] <== create_volume: return (205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.208s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.244s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1024474848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07271548-fdf0-4933-9ca6-f2794b24e00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='540960c1ff3543f8949305464619f0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:29Z,use_quota=True,user_id='2ce7986db6fa40338e7d3faced990fee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Creating volume 07271548-fdf0-4933-9ca6-f2794b24e00d {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:29 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c044c73-615a-4dc1-81e4-3f05d8299471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee582640-bdbe-4ac4-904c-6131e8c421f2', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fbf0d3-53ed-4f26-a829-663a62ba2752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:29 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume volume-ee582640-bdbe-4ac4-904c-6131e8c421f2 (ee582640-bdbe-4ac4-904c-6131e8c421f2): created successfully
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fbf0d3-53ed-4f26-a829-663a62ba2752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:29 devstack quobyte-client[79699]: System call "create" of process 86640 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Flow 'volume_create_manager' (0e91282a-4728-49da-8004-8a8268eb2f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:29 devstack quobyte-client[79699]: System call "getattr" of process 86640 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a09a1708-6781-4ad0-91cf-723f36b00b7e tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created volume successfully.
Sep 30 20:09:29 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=74, name=volume-07271548-fdf0-4933-9ca6-f2794b24e00d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e2154ae8-aaca-4143-ae72-fa8fcb47eb6e req-10fd0f9d-2022-4278-9d86-0ea14f2cd3d2 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d 1073741824" returned: 0 in 0.153s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] <== create_volume: return (180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.182s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e2154ae8-aaca-4143-ae72-fa8fcb47eb6e req-10fd0f9d-2022-4278-9d86-0ea14f2cd3d2 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.088s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee37c9-13cc-47bf-a03e-a2b020e2bcb4]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-e2154ae8-aaca-4143-ae72-fa8fcb47eb6e req-10fd0f9d-2022-4278-9d86-0ea14f2cd3d2 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6078b238-97ad-4dcc-a52a-e48985600ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07271548-fdf0-4933-9ca6-f2794b24e00d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9db3f-73ca-4bef-b837-e97c38420084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:29 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Volume volume-07271548-fdf0-4933-9ca6-f2794b24e00d (07271548-fdf0-4933-9ca6-f2794b24e00d): created successfully
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9db3f-73ca-4bef-b837-e97c38420084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Flow 'volume_create_manager' (82817576-654e-42fd-a348-ce9975a7176e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5c917998-a0a0-465f-bd90-b02749ad8d3e tempest-TaggedAttachmentsTest-827156841 None] Created volume successfully.
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-e2154ae8-aaca-4143-ae72-fa8fcb47eb6e req-10fd0f9d-2022-4278-9d86-0ea14f2cd3d2 tempest-AttachVolumeTestJSON-143237044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e" returned: 0 in 0.184s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e2154ae8-aaca-4143-ae72-fa8fcb47eb6e req-10fd0f9d-2022-4278-9d86-0ea14f2cd3d2 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.193s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e2154ae8-aaca-4143-ae72-fa8fcb47eb6e req-10fd0f9d-2022-4278-9d86-0ea14f2cd3d2 tempest-AttachVolumeTestJSON-143237044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-645015c4-656a-43a4-ab7e-e30cb50df14e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd302c59-2205-4b70-ba82-4fbc1f149c4c', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:09:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-e2154ae8-aaca-4143-ae72-fa8fcb47eb6e req-10fd0f9d-2022-4278-9d86-0ea14f2cd3d2 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-e2154ae8-aaca-4143-ae72-fa8fcb47eb6e req-10fd0f9d-2022-4278-9d86-0ea14f2cd3d2 tempest-AttachVolumeTestJSON-143237044 None] attachment_update completed successfully.
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-ee582640-bdbe-4ac4-904c-6131e8c421f2-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-ee582640-bdbe-4ac4-904c-6131e8c421f2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-quobyte-ee582640-bdbe-4ac4-904c-6131e8c421f2" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-ee582640-bdbe-4ac4-904c-6131e8c421f2" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ee6f8-1e45-47c9-88d0-4fff768cceaf]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ee582640-bdbe-4ac4-904c-6131e8c421f2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:30 devstack quobyte-client[79699]: System call "getattr" of process 86648 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ee582640-bdbe-4ac4-904c-6131e8c421f2" returned: 0 in 0.180s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ee582640-bdbe-4ac4-904c-6131e8c421f2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ee582640-bdbe-4ac4-904c-6131e8c421f2" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-ee582640-bdbe-4ac4-904c-6131e8c421f2" released by "delete_volume" :: held 0.244s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created reservations ['241ac253-2454-42c0-aea1-fa2ba28e0f50', '3278b0de-ca90-423d-a465-20e6a2a611d9', '9de44b63-a46f-4058-b11e-29d8789f99a8', '32d72254-07f8-4d0b-97a8-20bb9e8241bf'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Deleted volume successfully.
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f4d50834-23c9-4787-9a17-f8bd3c869c62 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-ee582640-bdbe-4ac4-904c-6131e8c421f2-delete_volume" released by "delete_volume" :: held 0.418s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-d3a47ef0-4398-4097-918d-2eaa17be9fad req-6f48b55b-df97-4fa8-bb6b-025575aafc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-d3a47ef0-4398-4097-918d-2eaa17be9fad req-6f48b55b-df97-4fa8-bb6b-025575aafc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-d3a47ef0-4398-4097-918d-2eaa17be9fad req-6f48b55b-df97-4fa8-bb6b-025575aafc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Terminate volume connection completed successfully.
Sep 30 20:09:30 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-d3a47ef0-4398-4097-918d-2eaa17be9fad req-6f48b55b-df97-4fa8-bb6b-025575aafc7d tempest-TestInstancesWithCinderVolumes-169740844 None] Deleting attachment 975add08-57b3-4599-a764-07fa6786a32d. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-47242bdb-b51c-47cc-b7b6-f75566b7934e-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-47242bdb-b51c-47cc-b7b6-f75566b7934e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=121,cinder:UPDATE=170,cinder:DELETE=15,cinder:INSERT=26 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=111,cinder:UPDATE=148,cinder:INSERT=43,cinder:DELETE=18 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:09:31 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-quobyte-47242bdb-b51c-47cc-b7b6-f75566b7934e" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-47242bdb-b51c-47cc-b7b6-f75566b7934e" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bbdd2d-e157-420c-a483-96001e02ddf9]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-47242bdb-b51c-47cc-b7b6-f75566b7934e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:31 devstack quobyte-client[79699]: System call "lookup" of process 86659 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:31 devstack quobyte-client[79699]: System call "getattr" of process 86659 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:31 devstack quobyte-client[79699]: System call "open" of process 86659 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-47242bdb-b51c-47cc-b7b6-f75566b7934e" returned: 0 in 0.180s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-47242bdb-b51c-47cc-b7b6-f75566b7934e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-47242bdb-b51c-47cc-b7b6-f75566b7934e" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-47242bdb-b51c-47cc-b7b6-f75566b7934e" released by "delete_volume" :: held 0.264s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created reservations ['56f0ae37-1205-4215-9c48-046ae5e243b5', 'e9278fd7-a554-4253-8f2f-2c801ef59c49', '426b120e-9bbe-4f0c-944f-e9a6dc14c53b', '90533c25-6cf2-4fd8-b4ec-58be745407a9'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.026s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:31 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Deleted volume successfully.
Sep 30 20:09:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5aa58d57-818d-4623-80fe-b2c3edc1c463 tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-47242bdb-b51c-47cc-b7b6-f75566b7934e-delete_volume" released by "delete_volume" :: held 0.497s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-76d8f1a7-bac4-4c87-94b2-672f095a1719-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-76d8f1a7-bac4-4c87-94b2-672f095a1719-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:32 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-quobyte-76d8f1a7-bac4-4c87-94b2-672f095a1719" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-76d8f1a7-bac4-4c87-94b2-672f095a1719" acquired by "delete_volume" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[254106a7-5452-48e0-ae75-530956fcfc3a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-76d8f1a7-bac4-4c87-94b2-672f095a1719 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-76d8f1a7-bac4-4c87-94b2-672f095a1719" returned: 0 in 0.141s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-76d8f1a7-bac4-4c87-94b2-672f095a1719 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-76d8f1a7-bac4-4c87-94b2-672f095a1719" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-76d8f1a7-bac4-4c87-94b2-672f095a1719" released by "delete_volume" :: held 0.202s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created reservations ['f4cb0dd0-2547-454e-b3ee-5c4cd119e8c0', '08e10d1e-8092-40c9-b6f0-debf0f8d007d', 'd4a4cdd5-a6ac-4911-af0c-cfb256666df3', '119e21a7-0fb7-4c15-82e3-f2a8ff5f5724'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:32 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Deleted volume successfully.
Sep 30 20:09:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a39f81e2-c8c0-4c26-ab8d-dcdb903dd53b tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-76d8f1a7-bac4-4c87-94b2-672f095a1719-delete_volume" released by "delete_volume" :: held 0.347s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-55d071d5-2870-42ca-9466-463184372cd0-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-55d071d5-2870-42ca-9466-463184372cd0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:33 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-quobyte-55d071d5-2870-42ca-9466-463184372cd0" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-55d071d5-2870-42ca-9466-463184372cd0" acquired by "delete_volume" :: waited 0.021s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5df4d8-84a6-4df9-865f-a2b3a3b2eb2d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-55d071d5-2870-42ca-9466-463184372cd0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "cinder-64a53cb9-aeee-4c8d-a268-474990f0ae91-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-64a53cb9-aeee-4c8d-a268-474990f0ae91-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:33 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "cinder-quobyte-64a53cb9-aeee-4c8d-a268-474990f0ae91" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-quobyte-64a53cb9-aeee-4c8d-a268-474990f0ae91" acquired by "delete_volume" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7833eb6c-8d0a-46cb-8753-10623fc5265a]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-55d071d5-2870-42ca-9466-463184372cd0" returned: 0 in 0.151s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-55d071d5-2870-42ca-9466-463184372cd0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-55d071d5-2870-42ca-9466-463184372cd0" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-55d071d5-2870-42ca-9466-463184372cd0" released by "delete_volume" :: held 0.206s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created reservations ['64cc299e-10db-4e8e-a3b6-80f02e98043e', '503e6cd9-716d-4282-bb9c-1962dd9cadfa', 'def35a4e-1eba-44ea-9e68-2dfebe94d2f1', '6ddb2af6-9d90-4397-ae14-e3ff7e40dac0'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:33 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Deleted volume successfully.
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 0 in 0.181s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-04b40f41-6409-485a-9b8a-a9a961abd6be tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-55d071d5-2870-42ca-9466-463184372cd0-delete_volume" released by "delete_volume" :: held 0.378s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:34 devstack quobyte-client[79699]: System call "getattr" of process 86677 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 1 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64a53cb9-aeee-4c8d-a268-474990f0ae91" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-quobyte-64a53cb9-aeee-4c8d-a268-474990f0ae91" released by "delete_volume" :: held 0.390s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:09:34 devstack cinder-volume[79893]: WARNING cinder.quota [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2114181769-2052461564 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2114181769-2052461564, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:09:34 devstack cinder-volume[79893]: WARNING cinder.quota [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2114181769-2052461564 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2114181769-2052461564, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Created reservations ['32adeb54-7d12-4426-87db-5cc73ee2f657', '0a10a39b-e8c7-4eb5-b93a-f1cbe6adc03f', '2db996f2-fce3-4f46-b650-a2e4f846d637', '6918d00f-02fe-4625-9878-d4aed452127d'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.026s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:34 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Deleted volume successfully.
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-01762dfe-0579-4625-95b3-462ce5854fe1 tempest-TestInstancesWithCinderVolumes-169740844 None] Lock "cinder-64a53cb9-aeee-4c8d-a268-474990f0ae91-delete_volume" released by "delete_volume" :: held 0.552s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-ba5bdfde-73a8-4f9d-ae43-397c57848512-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-ba5bdfde-73a8-4f9d-ae43-397c57848512-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-quobyte-ba5bdfde-73a8-4f9d-ae43-397c57848512" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-ba5bdfde-73a8-4f9d-ae43-397c57848512" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5dab5c-75b7-4a63-bfeb-433677a2c026]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ba5bdfde-73a8-4f9d-ae43-397c57848512 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ba5bdfde-73a8-4f9d-ae43-397c57848512" returned: 0 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ba5bdfde-73a8-4f9d-ae43-397c57848512 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ba5bdfde-73a8-4f9d-ae43-397c57848512" returned: 0 in 0.040s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:34 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-ba5bdfde-73a8-4f9d-ae43-397c57848512" released by "delete_volume" :: held 0.205s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created reservations ['638d5a79-2604-4068-9efa-c0b4ee52cfd5', 'bb0847c5-b560-43b9-a2b9-95067da740f6', '6b2bb6e0-257e-43df-8ac3-e0bb61b878e1', '5104ffee-293d-48d3-8c7b-51c04932ceb7'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Deleted volume successfully.
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a85fff67-c613-4713-9f41-4e4f75a7ab5f tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-ba5bdfde-73a8-4f9d-ae43-397c57848512-delete_volume" released by "delete_volume" :: held 0.420s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-8e9069db-37a2-49a7-9d14-96815dc8e6b4-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-8e9069db-37a2-49a7-9d14-96815dc8e6b4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:35 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "cinder-quobyte-8e9069db-37a2-49a7-9d14-96815dc8e6b4" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-8e9069db-37a2-49a7-9d14-96815dc8e6b4" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0908ef-8bc3-4cab-8e58-430f2451fcd5]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4" returned: 0 in 0.160s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8e9069db-37a2-49a7-9d14-96815dc8e6b4" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-quobyte-8e9069db-37a2-49a7-9d14-96815dc8e6b4" released by "delete_volume" :: held 0.239s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Created reservations ['ff275bd8-f6ba-46d1-994e-1171cd9b3a1d', 'cc85aad8-d3e9-4db4-a304-9f3c7602dc0b', '8a116464-afd2-45a6-bd2d-f445e8d8e516', 'e154d04e-110a-46ce-bd84-44a3d6706b73'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:36 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Deleted volume successfully.
Sep 30 20:09:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4f32e677-65d2-44fa-8086-8b9d683cf4fa tempest-CreateVolumesFromSourceVolumeTest-1668009502 None] Lock "cinder-8e9069db-37a2-49a7-9d14-96815dc8e6b4-delete_volume" released by "delete_volume" :: held 0.422s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:41 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Flow 'volume_create_manager' (e479a68f-5fe5-4940-aa39-559fc41bcdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086d6ee3-ffa0-4d66-bcb7-6d326ed1436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086d6ee3-ffa0-4d66-bcb7-6d326ed1436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5680a85-3967-4e15-9075-51f5547c6ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a2be49508d44d9aec5c08157a91d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:41Z,use_quota=True,user_id='3aeb218d66d04fdeb0c1507afdf2ff3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4103e1-4d49-4372-be24-82e40a53e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f4103e1-4d49-4372-be24-82e40a53e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9296ee-e016-4528-8357-35f8ad534950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.image.glance [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Creating Keystone auth plugin from conf {{(pid=79893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9296ee-e016-4528-8357-35f8ad534950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5680a85-3967-4e15-9075-51f5547c6ecf', 'volume_name': 'volume-f5680a85-3967-4e15-9075-51f5547c6ecf', 'volume_size': 1, 'image_id': 'd5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bfed7ce7c8c8f04a49275e13927d01e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73a2be49508d44d9aec5c08157a91d7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '230226d855494b0a1719c1f5ff64f45c9d3606a82177fbbcca923cc049f7783fda7a3f539486b3c981433cf785e0d644e803103140cf99f2647d2b4283b21a6f', 'id': 'd5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'created_at': datetime.datetime(2025, 9, 30, 18, 9, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e22e2c0>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9520388-dcbc-4d7f-a39d-815328d7cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9520388-dcbc-4d7f-a39d-815328d7cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31ec0c2-30b3-470d-a121-7c042af18c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:41 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Volume f5680a85-3967-4e15-9075-51f5547c6ecf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5680a85-3967-4e15-9075-51f5547c6ecf', 'volume_size': 1, 'image_id': 'd5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bfed7ce7c8c8f04a49275e13927d01e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73a2be49508d44d9aec5c08157a91d7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '230226d855494b0a1719c1f5ff64f45c9d3606a82177fbbcca923cc049f7783fda7a3f539486b3c981433cf785e0d644e803103140cf99f2647d2b4283b21a6f', 'id': 'd5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'created_at': datetime.datetime(2025, 9, 30, 18, 9, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e22e2c0>}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Cloning f5680a85-3967-4e15-9075-51f5547c6ecf from image d5979d28-dbfd-4959-bedf-c6ea9a06ce67  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'metadata': {}}]). {{(pid=79893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 20:09:41 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Image download 0.00 MB at 0.00 MB/s
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[82da8bb1-568a-443a-ad4d-eec20719577a]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:41 devstack sudo[86720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD
Sep 30 20:09:41 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:09:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:09:42 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root
Sep 30 20:09:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD" returned: 0 in 0.687s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:42 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD
Sep 30 20:09:42 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:09:42 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Sep 30 20:09:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD" returned: 1 in 0.663s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:42 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Temporary image d5979d28-dbfd-4959-bedf-c6ea9a06ce67 is fetched for user 3aeb218d66d04fdeb0c1507afdf2ff3b. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 20:09:42 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3988c1-be38-4faf-8478-31f9c458012e]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:42 devstack sudo[86733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD
Sep 30 20:09:42 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:09:43 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD" returned: 0 in 0.662s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:43 devstack sudo[86737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD
Sep 30 20:09:43 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:09:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (93a11720-a5dc-4fa9-b324-d877c1870743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9548fb1-49c0-45f3-973d-23f11eebd7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9548fb1-49c0-45f3-973d-23f11eebd7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93222828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e13de9-003d-4e2a-adbc-2f1650d84f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:44Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546b486f-d1d1-4f1b-bc8b-35dce7209545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546b486f-d1d1-4f1b-bc8b-35dce7209545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fdd98f-317b-4bb8-b942-efd8c5b70345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fdd98f-317b-4bb8-b942-efd8c5b70345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e13de9-003d-4e2a-adbc-2f1650d84f19', 'volume_name': 'volume-19e13de9-003d-4e2a-adbc-2f1650d84f19', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361c1d3b-b11f-4575-a22f-8223de270d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361c1d3b-b11f-4575-a22f-8223de270d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95322ea-c346-4f7e-aa59-b63cdc2c8419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:43 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume 19e13de9-003d-4e2a-adbc-2f1650d84f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e13de9-003d-4e2a-adbc-2f1650d84f19', 'volume_size': 1}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93222828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e13de9-003d-4e2a-adbc-2f1650d84f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:44Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Creating volume 19e13de9-003d-4e2a-adbc-2f1650d84f19 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:43 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:43 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=75, name=volume-19e13de9-003d-4e2a-adbc-2f1650d84f19, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 1073741824" returned: 0 in 0.186s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] <== create_volume: return (228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.230s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95322ea-c346-4f7e-aa59-b63cdc2c8419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e13de9-003d-4e2a-adbc-2f1650d84f19', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791595e9-6ae8-4313-81df-055d8e5e5922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:44 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 (19e13de9-003d-4e2a-adbc-2f1650d84f19): created successfully
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791595e9-6ae8-4313-81df-055d8e5e5922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (93a11720-a5dc-4fa9-b324-d877c1870743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:44 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8941d23f-4086-4447-a756-6b57e0a986ac tempest-CreateVolumesFromSnapshotTest-831994119 None] Created volume successfully.
Sep 30 20:09:44 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD" returned: 1 in 0.594s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5680a85-3967-4e15-9075-51f5547c6ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73a2be49508d44d9aec5c08157a91d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:41Z,use_quota=True,user_id='3aeb218d66d04fdeb0c1507afdf2ff3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Creating volume f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:44 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:44 devstack quobyte-client[79699]: System call "lookup" of process 86753 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:44 devstack quobyte-client[79699]: System call "create" of process 86753 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:44 devstack quobyte-client[79699]: System call "getattr" of process 86753 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:44 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=76, name=volume-f5680a85-3967-4e15-9075-51f5547c6ecf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf 1073741824" returned: 0 in 0.173s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] <== create_volume: return (200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.203s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Attempting download of d5979d28-dbfd-4959-bedf-c6ea9a06ce67 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'metadata': {}}])) to volume f5680a85-3967-4e15-9075-51f5547c6ecf. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0678c54c-e1b2-46cf-96b1-38bd2c87d1be]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5979d28-dbfd-4959-bedf-c6ea9a06ce67_isgy2dti {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d5979d28-dbfd-4959-bedf-c6ea9a06ce67_isgy2dti" returned: 0 in 0.114s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5979d28-dbfd-4959-bedf-c6ea9a06ce67_isgy2dti {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5979d28-dbfd-4959-bedf-c6ea9a06ce67_isgy2dti" returned: 1 in 0.131s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d5979d28-dbfd-4959-bedf-c6ea9a06ce67_isgy2dti' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa71b1c-089e-4807-8da6-acdb476ff641]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD" returned: 0 in 0.125s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:44 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD" returned: 1 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] d5979d28-dbfd-4959-bedf-c6ea9a06ce67 was raw, converting to raw {{(pid=79893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Creating offline snapshot 9c6a592c-442a-4316-a68e-10f0f0f350bf of volume 19e13de9-003d-4e2a-adbc-2f1650d84f19 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c88abe-2ffe-4f93-b4d7-b68629849abf]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:44 devstack quobyte-client[79699]: System call "lookup" of process 86774 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:44 devstack quobyte-client[79699]: System call "getattr" of process 86774 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:44 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=76, name=volume-f5680a85-3967-4e15-9075-51f5547c6ecf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf" returned: 0 in 0.189s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d5979d28-dbfd-4959-bedf-c6ea9a06ce67__6bomlkfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:09:45 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Converted 0.00 MB image at 0.00 MB/s
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack quobyte-client[79699]: System call "open" of process 86776 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:45 devstack quobyte-client[79699]: System call "getattr" of process 86799 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19" returned: 0 in 0.231s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf 1G" returned: 0 in 0.103s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack quobyte-client[79699]: System call "open" of process 86818 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ea938c-d6f6-489c-9902-214e3aff69ff]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=77, name=volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf 1G" returned: 0 in 0.249s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img rebase -u -b volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack quobyte-client[79699]: System call "lookup" of process 86824 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:45 devstack quobyte-client[79699]: System call "getattr" of process 86824 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:45 devstack quobyte-client[79699]: System call "open" of process 86839 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf" returned: 0 in 0.253s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img rebase -u -b volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf" returned: 0 in 0.101s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf" returned: 0 in 0.068s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.info" returned: 0 in 0.042s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.info" returned: 0 in 0.035s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.827s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf" returned: 1 in 0.239s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Downloaded image d5979d28-dbfd-4959-bedf-c6ea9a06ce67 ((None, [{'url': 'file:///opt/stack/data/glance/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'metadata': {}}])) to volume f5680a85-3967-4e15-9075-51f5547c6ecf successfully. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Temporary image d5979d28-dbfd-4959-bedf-c6ea9a06ce67 for user 3aeb218d66d04fdeb0c1507afdf2ff3b is deleted. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Marking volume f5680a85-3967-4e15-9075-51f5547c6ecf as bootable. {{(pid=79893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Copying metadata from image d5979d28-dbfd-4959-bedf-c6ea9a06ce67 to f5680a85-3967-4e15-9075-51f5547c6ecf. {{(pid=79893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Creating volume glance metadata for volume f5680a85-3967-4e15-9075-51f5547c6ecf backed by image d5979d28-dbfd-4959-bedf-c6ea9a06ce67 with: {'image_id': 'd5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5bfed7ce7c8c8f04a49275e13927d01e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=79893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 20:09:45 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-9b558117-e4ae-459c-824e-65ac86be49d0 tempest-CreateVolumesFromSnapshotTest-831994119 None] Create snapshot completed successfully
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31ec0c2-30b3-470d-a121-7c042af18c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5680a85-3967-4e15-9075-51f5547c6ecf', 'volume_size': 1, 'image_id': 'd5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bfed7ce7c8c8f04a49275e13927d01e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '73a2be49508d44d9aec5c08157a91d7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '230226d855494b0a1719c1f5ff64f45c9d3606a82177fbbcca923cc049f7783fda7a3f539486b3c981433cf785e0d644e803103140cf99f2647d2b4283b21a6f', 'id': 'd5979d28-dbfd-4959-bedf-c6ea9a06ce67', 'created_at': datetime.datetime(2025, 9, 30, 18, 9, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 9, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d5979d28-dbfd-4959-bedf-c6ea9a06ce67/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e22e2c0>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9bffc6-57e2-4193-a26b-0ac932cd53b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:45 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Volume volume-f5680a85-3967-4e15-9075-51f5547c6ecf (f5680a85-3967-4e15-9075-51f5547c6ecf): created successfully
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9bffc6-57e2-4193-a26b-0ac932cd53b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Flow 'volume_create_manager' (e479a68f-5fe5-4940-aa39-559fc41bcdc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:45 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3069b515-488f-424b-9eb3-7daed2db1207 tempest-VolumeImageDependencyTests-1603433138 None] Created volume successfully.
Sep 30 20:09:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (7adc579b-4ae9-40d0-8a22-e0f966196d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65b5b2d-6774-44bf-ac8a-5d01db49d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b65b5b2d-6774-44bf-ac8a-5d01db49d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-696552410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de029873-8709-4eaf-bea3-acd4dd61a8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:46Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7efe5b-2cf4-494a-a41c-90da0d1d574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7efe5b-2cf4-494a-a41c-90da0d1d574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe434ac8-1d72-42f1-8f04-a1d1955d3bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe434ac8-1d72-42f1-8f04-a1d1955d3bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de029873-8709-4eaf-bea3-acd4dd61a8c5', 'volume_name': 'volume-de029873-8709-4eaf-bea3-acd4dd61a8c5', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4c70ba-61c5-45b0-952e-797749334946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4c70ba-61c5-45b0-952e-797749334946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91fb362-b9b4-421b-833f-230f23682ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume de029873-8709-4eaf-bea3-acd4dd61a8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de029873-8709-4eaf-bea3-acd4dd61a8c5', 'volume_size': 1}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-696552410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de029873-8709-4eaf-bea3-acd4dd61a8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:46Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Creating volume de029873-8709-4eaf-bea3-acd4dd61a8c5 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-de029873-8709-4eaf-bea3-acd4dd61a8c5 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:46 devstack quobyte-client[79699]: System call "getlk" of process 86860 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:46 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=79, name=volume-de029873-8709-4eaf-bea3-acd4dd61a8c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (75c5b7e3-0fa2-4186-8843-9bcf1be0eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a8592f-81b3-47b1-bb9d-37832b11ff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a8592f-81b3-47b1-bb9d-37832b11ff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-833387796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ceecfc-3976-432d-9424-fa3c81b5825b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:46Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceec7a3c-37a8-4be3-b4d8-f35d7959f1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceec7a3c-37a8-4be3-b4d8-f35d7959f1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2495b05-c20b-46ca-8680-1bcb286283b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2495b05-c20b-46ca-8680-1bcb286283b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ceecfc-3976-432d-9424-fa3c81b5825b', 'volume_name': 'volume-b5ceecfc-3976-432d-9424-fa3c81b5825b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b7c519-3f63-47ad-b309-dfc48ab65857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2b7c519-3f63-47ad-b309-dfc48ab65857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2be3b8-bdce-4465-8857-939a38a9bdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume b5ceecfc-3976-432d-9424-fa3c81b5825b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ceecfc-3976-432d-9424-fa3c81b5825b', 'volume_size': 1}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-de029873-8709-4eaf-bea3-acd4dd61a8c5 1073741824" returned: 0 in 0.196s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-de029873-8709-4eaf-bea3-acd4dd61a8c5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-de029873-8709-4eaf-bea3-acd4dd61a8c5" returned: 0 in 0.047s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] <== create_volume: return (252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.254s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.059s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-833387796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ceecfc-3976-432d-9424-fa3c81b5825b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:46Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Creating volume b5ceecfc-3976-432d-9424-fa3c81b5825b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b5ceecfc-3976-432d-9424-fa3c81b5825b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91fb362-b9b4-421b-833f-230f23682ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de029873-8709-4eaf-bea3-acd4dd61a8c5', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66307bb-09db-464b-be9f-ea169a9c5d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack quobyte-client[79699]: System call "lookup" of process 86864 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume volume-de029873-8709-4eaf-bea3-acd4dd61a8c5 (de029873-8709-4eaf-bea3-acd4dd61a8c5): created successfully
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66307bb-09db-464b-be9f-ea169a9c5d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (7adc579b-4ae9-40d0-8a22-e0f966196d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:46 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=80, name=volume-b5ceecfc-3976-432d-9424-fa3c81b5825b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-06a0e72d-3694-4d69-b51b-7bf6cbd9833b tempest-CreateVolumesFromSnapshotTest-831994119 None] Created volume successfully.
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Acquiring lock "cinder-f5680a85-3967-4e15-9075-51f5547c6ecf-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Lock "cinder-f5680a85-3967-4e15-9075-51f5547c6ecf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b5ceecfc-3976-432d-9424-fa3c81b5825b 1073741824" returned: 0 in 0.270s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Acquiring lock "cinder-quobyte-f5680a85-3967-4e15-9075-51f5547c6ecf" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b5ceecfc-3976-432d-9424-fa3c81b5825b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (a21b11df-cb42-4f6e-ba82-3088b0fe2381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c773ced-ba07-49cf-83c0-df803d909e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c773ced-ba07-49cf-83c0-df803d909e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2063402297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d42b4b-7fc1-4b3b-826c-276ca5508467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:47Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec61379-4bc4-4da9-ada3-132de9c9f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec61379-4bc4-4da9-ada3-132de9c9f84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70256c2f-9167-4181-ab86-629a2f2f676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70256c2f-9167-4181-ab86-629a2f2f676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d42b4b-7fc1-4b3b-826c-276ca5508467', 'volume_name': 'volume-48d42b4b-7fc1-4b3b-826c-276ca5508467', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e259ae-010d-4ce9-86b7-1bf46c7ac525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e259ae-010d-4ce9-86b7-1bf46c7ac525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32be40da-8ede-4bbe-994a-66fec4d454d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume 48d42b4b-7fc1-4b3b-826c-276ca5508467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d42b4b-7fc1-4b3b-826c-276ca5508467', 'volume_size': 1}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b5ceecfc-3976-432d-9424-fa3c81b5825b" returned: 0 in 0.074s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] <== create_volume: return (361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.364s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2063402297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d42b4b-7fc1-4b3b-826c-276ca5508467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:47Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Creating volume 48d42b4b-7fc1-4b3b-826c-276ca5508467 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48d42b4b-7fc1-4b3b-826c-276ca5508467 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2be3b8-bdce-4465-8857-939a38a9bdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ceecfc-3976-432d-9424-fa3c81b5825b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2547d18b-92f6-4caa-b750-f0fbb6168353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Lock "cinder-quobyte-f5680a85-3967-4e15-9075-51f5547c6ecf" acquired by "delete_volume" :: waited 0.128s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:46 devstack quobyte-client[79699]: System call "getattr" of process 86869 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:46 devstack quobyte-client[79699]: System call "lookup" of process 86869 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:46 devstack quobyte-client[79699]: System call "create" of process 86869 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:46 devstack quobyte-client[79699]: System call "getattr" of process 86869 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume volume-b5ceecfc-3976-432d-9424-fa3c81b5825b (b5ceecfc-3976-432d-9424-fa3c81b5825b): created successfully
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2547d18b-92f6-4caa-b750-f0fbb6168353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:46 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=81, name=volume-48d42b4b-7fc1-4b3b-826c-276ca5508467, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (75c5b7e3-0fa2-4186-8843-9bcf1be0eae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e82e45b-77f2-4817-bc15-131da3326675]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-dc79f269-144f-45ed-9384-65d15f7e4bfe tempest-CreateVolumesFromSnapshotTest-831994119 None] Created volume successfully.
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48d42b4b-7fc1-4b3b-826c-276ca5508467 1073741824" returned: 0 in 0.197s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48d42b4b-7fc1-4b3b-826c-276ca5508467 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (d7091812-ba21-49a2-8978-c6902eed543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11971c1b-cef0-4e24-a652-7e54f59d7699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11971c1b-cef0-4e24-a652-7e54f59d7699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1218417734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4fd8a5-3104-4a69-bf6f-1ce8950534dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:47Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff489102-d8d5-4597-a687-3fe21a91c4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff489102-d8d5-4597-a687-3fe21a91c4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb874161-0ec6-4c95-9da2-37e40bead601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb874161-0ec6-4c95-9da2-37e40bead601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a4fd8a5-3104-4a69-bf6f-1ce8950534dd', 'volume_name': 'volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4bdfdf-b8da-4a15-8b5e-b5811795d925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4bdfdf-b8da-4a15-8b5e-b5811795d925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a643a3b-452b-4f7a-9ac1-bd5fd35744c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume 4a4fd8a5-3104-4a69-bf6f-1ce8950534dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd', 'volume_size': 1}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf" returned: 0 in 0.269s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48d42b4b-7fc1-4b3b-826c-276ca5508467" returned: 0 in 0.165s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] <== create_volume: return (380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.384s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1218417734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a4fd8a5-3104-4a69-bf6f-1ce8950534dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:47Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Creating volume 4a4fd8a5-3104-4a69-bf6f-1ce8950534dd {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32be40da-8ede-4bbe-994a-66fec4d454d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d42b4b-7fc1-4b3b-826c-276ca5508467', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49321d1-cc0d-4a8f-aa05-d57ae17b7ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack quobyte-client[79699]: System call "lookup" of process 86876 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume volume-48d42b4b-7fc1-4b3b-826c-276ca5508467 (48d42b4b-7fc1-4b3b-826c-276ca5508467): created successfully
Sep 30 20:09:47 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=82, name=volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49321d1-cc0d-4a8f-aa05-d57ae17b7ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (a21b11df-cb42-4f6e-ba82-3088b0fe2381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1a9c3eb0-2952-423c-a232-1c158cf24c3c tempest-CreateVolumesFromSnapshotTest-831994119 None] Created volume successfully.
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf" returned: 1 in 0.244s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd 1073741824" returned: 0 in 0.204s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (9c35251f-3a06-422f-9009-48ff3fbc2fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09423d10-941f-4431-8f9b-21fa0fd3e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09423d10-941f-4431-8f9b-21fa0fd3e4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397043486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4481e44-3143-4104-a5bd-fe67d4253c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:47Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bea50a-48ab-4d50-b067-d682cdce6066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bea50a-48ab-4d50-b067-d682cdce6066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049a9bf6-7287-47ab-b91a-6a9cc8c1c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049a9bf6-7287-47ab-b91a-6a9cc8c1c01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4481e44-3143-4104-a5bd-fe67d4253c40', 'volume_name': 'volume-d4481e44-3143-4104-a5bd-fe67d4253c40', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dabe0e9-8c46-4232-b360-5572fdafa712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dabe0e9-8c46-4232-b360-5572fdafa712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700d01bc-f2d7-42d2-bbf6-c8d9a6a68f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume d4481e44-3143-4104-a5bd-fe67d4253c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4481e44-3143-4104-a5bd-fe67d4253c40', 'volume_size': 1}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f5680a85-3967-4e15-9075-51f5547c6ecf" returned: 0 in 0.125s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd" returned: 0 in 0.062s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] <== create_volume: return (324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.332s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Lock "cinder-quobyte-f5680a85-3967-4e15-9075-51f5547c6ecf" released by "delete_volume" :: held 0.712s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397043486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4481e44-3143-4104-a5bd-fe67d4253c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64b64229360d4dfea43a4ff36f9d2931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:09:47Z,use_quota=True,user_id='65dafb5c3405499098107125a6cfc580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Creating volume d4481e44-3143-4104-a5bd-fe67d4253c40 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4481e44-3143-4104-a5bd-fe67d4253c40 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:47 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=83, name=volume-d4481e44-3143-4104-a5bd-fe67d4253c40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a643a3b-452b-4f7a-9ac1-bd5fd35744c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ac7d29-b26b-424f-b44a-411025627685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Created reservations ['6c52ae6f-75a1-4743-b56a-a42fb7094ab8', '3c2fe846-b008-4f1a-8c12-96f515997055', '7f24a1a2-e0aa-405b-a134-a461c3669f8a', '4cf5b98e-f9d3-44c0-9615-58092d2fdd69'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd (4a4fd8a5-3104-4a69-bf6f-1ce8950534dd): created successfully
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ac7d29-b26b-424f-b44a-411025627685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (d7091812-ba21-49a2-8978-c6902eed543b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4481e44-3143-4104-a5bd-fe67d4253c40 1073741824" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4481e44-3143-4104-a5bd-fe67d4253c40 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e816e149-1b5c-49bd-abd9-cdb73a4ec547 tempest-CreateVolumesFromSnapshotTest-831994119 None] Created volume successfully.
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.036s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4481e44-3143-4104-a5bd-fe67d4253c40" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Deleted volume successfully.
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] <== create_volume: return (180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.184s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700d01bc-f2d7-42d2-bbf6-c8d9a6a68f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4481e44-3143-4104-a5bd-fe67d4253c40', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998b84a3-e7cc-4930-ae46-d14cbd0af1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume volume-d4481e44-3143-4104-a5bd-fe67d4253c40 (d4481e44-3143-4104-a5bd-fe67d4253c40): created successfully
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998b84a3-e7cc-4930-ae46-d14cbd0af1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Flow 'volume_create_manager' (9c35251f-3a06-422f-9009-48ff3fbc2fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:09:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3b28ddcb-241b-44c6-a961-ba05721c5cf4 tempest-VolumeImageDependencyTests-1603433138 None] Lock "cinder-f5680a85-3967-4e15-9075-51f5547c6ecf-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-db8af3e0-4ae0-4486-bca1-0fe34e427293 tempest-CreateVolumesFromSnapshotTest-831994119 None] Created volume successfully.
Sep 30 20:09:48 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-d4481e44-3143-4104-a5bd-fe67d4253c40-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:48 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-d4481e44-3143-4104-a5bd-fe67d4253c40-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:48 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:48 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-quobyte-d4481e44-3143-4104-a5bd-fe67d4253c40" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:48 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-d4481e44-3143-4104-a5bd-fe67d4253c40" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:48 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d0397f-a7ae-4219-8e29-bb3c521d686c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:48 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4481e44-3143-4104-a5bd-fe67d4253c40 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4481e44-3143-4104-a5bd-fe67d4253c40" returned: 0 in 0.205s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4481e44-3143-4104-a5bd-fe67d4253c40 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4481e44-3143-4104-a5bd-fe67d4253c40" returned: 0 in 0.056s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-d4481e44-3143-4104-a5bd-fe67d4253c40" released by "delete_volume" :: held 0.305s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Created reservations ['6f9f30c2-f027-4b23-834d-9e0d5317cc40', '727b1bbd-88cc-4861-a79f-b963cb732397', 'f7ecf984-5aa1-4795-80d7-65aa579c1d70', 'ea6fd5e7-8a01-406f-9fd7-3bf1a34c669a'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.058s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:49 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Deleted volume successfully.
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9aaffd1a-01db-4d14-b9ca-b387ea2eba09 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-d4481e44-3143-4104-a5bd-fe67d4253c40-delete_volume" released by "delete_volume" :: held 0.569s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:49 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-quobyte-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a87f37-d936-4af3-9965-0f45ea8d7cc8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd" returned: 0 in 0.136s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd" released by "delete_volume" :: held 0.180s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Created reservations ['bf048279-8552-4887-afc2-79cf4bca6da7', 'ef10d86b-d657-4469-9258-659cfcee675d', 'edbac11b-e64e-4d44-ab8d-ec3439d7fe51', 'dc49fe89-ead2-4a3c-9278-bddd1e982d23'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:50 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Deleted volume successfully.
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b318c022-f96f-4889-a420-60703e7a498c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-4a4fd8a5-3104-4a69-bf6f-1ce8950534dd-delete_volume" released by "delete_volume" :: held 0.342s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-48d42b4b-7fc1-4b3b-826c-276ca5508467-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:50 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-48d42b4b-7fc1-4b3b-826c-276ca5508467-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:51 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-quobyte-48d42b4b-7fc1-4b3b-826c-276ca5508467" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-48d42b4b-7fc1-4b3b-826c-276ca5508467" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7027ab47-13bd-4896-8600-bf46a5cb48ed]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48d42b4b-7fc1-4b3b-826c-276ca5508467 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48d42b4b-7fc1-4b3b-826c-276ca5508467" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48d42b4b-7fc1-4b3b-826c-276ca5508467 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48d42b4b-7fc1-4b3b-826c-276ca5508467" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-48d42b4b-7fc1-4b3b-826c-276ca5508467" released by "delete_volume" :: held 0.179s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Created reservations ['2c91862c-5ae7-4a8a-979d-6fc4fb5c2c72', '9a51d2fd-974c-41fb-986b-9dd43bcc669e', '7b4a2589-d421-4e26-b9ef-5f01cf99e6fc', '827ab313-6188-4b1b-877b-57bde621616d'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:51 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Deleted volume successfully.
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bae9a6d7-c502-4c59-9427-1f69b712232b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-48d42b4b-7fc1-4b3b-826c-276ca5508467-delete_volume" released by "delete_volume" :: held 0.335s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-b5ceecfc-3976-432d-9424-fa3c81b5825b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-b5ceecfc-3976-432d-9424-fa3c81b5825b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:52 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-quobyte-b5ceecfc-3976-432d-9424-fa3c81b5825b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-b5ceecfc-3976-432d-9424-fa3c81b5825b" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0299a5-8905-42fe-91f0-6d3d7637e7ca]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b5ceecfc-3976-432d-9424-fa3c81b5825b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b5ceecfc-3976-432d-9424-fa3c81b5825b" returned: 0 in 0.149s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b5ceecfc-3976-432d-9424-fa3c81b5825b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-b5ceecfc-3976-432d-9424-fa3c81b5825b" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-b5ceecfc-3976-432d-9424-fa3c81b5825b" released by "delete_volume" :: held 0.187s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Created reservations ['1aade878-b046-44bf-b086-bee3b760c393', '11ca0952-5ff9-455d-84d7-41164751e536', '407b21d9-595c-47cb-922e-97d8c651d485', '7c8c514e-9091-4df6-9509-e78a1cc2a72c'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:52 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Deleted volume successfully.
Sep 30 20:09:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce114dc6-3deb-4e73-9d85-32da846733dd tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-b5ceecfc-3976-432d-9424-fa3c81b5825b-delete_volume" released by "delete_volume" :: held 0.359s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-de029873-8709-4eaf-bea3-acd4dd61a8c5-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-de029873-8709-4eaf-bea3-acd4dd61a8c5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:53 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-quobyte-de029873-8709-4eaf-bea3-acd4dd61a8c5" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-de029873-8709-4eaf-bea3-acd4dd61a8c5" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[519477cc-2985-4ecb-8d07-56c68461df03]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-de029873-8709-4eaf-bea3-acd4dd61a8c5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:53 devstack quobyte-client[79699]: System call "getattr" of process 86914 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-de029873-8709-4eaf-bea3-acd4dd61a8c5" returned: 0 in 0.150s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-de029873-8709-4eaf-bea3-acd4dd61a8c5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-de029873-8709-4eaf-bea3-acd4dd61a8c5" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-de029873-8709-4eaf-bea3-acd4dd61a8c5" released by "delete_volume" :: held 0.189s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Created reservations ['df691688-2993-4849-91d0-5f5511a7899f', '1bfc59d5-53d0-4433-b619-cccf379d51fc', '84e30ee3-9e12-4915-88d8-18e5e06787af', 'be2cb34f-f4f2-4efd-b999-3d2f028b5a15'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:53 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Deleted volume successfully.
Sep 30 20:09:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d499c67-6b17-49a3-9ba8-62486c3967d8 tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-de029873-8709-4eaf-bea3-acd4dd61a8c5-delete_volume" released by "delete_volume" :: held 0.351s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-9c6a592c-442a-4316-a68e-10f0f0f350bf-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-9c6a592c-442a-4316-a68e-10f0f0f350bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-quobyte-19e13de9-003d-4e2a-adbc-2f1650d84f19" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-19e13de9-003d-4e2a-adbc-2f1650d84f19" acquired by "delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-quobyte-9c6a592c-442a-4316-a68e-10f0f0f350bf" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-9c6a592c-442a-4316-a68e-10f0f0f350bf" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Deleting offline snapshot 9c6a592c-442a-4316-a68e-10f0f0f350bf of volume 19e13de9-003d-4e2a-adbc-2f1650d84f19 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] snapshot_file for this snap is: volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3b13c6-be4f-408f-bff5-a27338da17d6]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19e13de9-003d-4e2a-adbc-2f1650d84f19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96f6201-2b18-498d-92b2-0e3538fd2365]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19" returned: 0 in 0.140s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:54 devstack quobyte-client[79699]: System call "getattr" of process 86925 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:54 devstack quobyte-client[79699]: System call "open" of process 86925 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf" returned: 0 in 0.078s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19.9c6a592c-442a-4316-a68e-10f0f0f350bf" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-9c6a592c-442a-4316-a68e-10f0f0f350bf" released by "_delete_snapshot" :: held 0.432s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-19e13de9-003d-4e2a-adbc-2f1650d84f19" released by "delete_snapshot" :: held 0.444s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Created reservations ['8de12034-0e2e-495d-9cb4-d3698a2607b2', '59314e80-319e-45bb-a93d-9906ec9db18f', '72539849-87ac-4ae8-9abf-11cb4328a525', 'bf1875d0-88ca-48bb-9e12-f7eda6610661'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Delete snapshot completed successfully.
Sep 30 20:09:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7ea1f30d-12bf-4922-89bc-8b4b06df870c tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-9c6a592c-442a-4316-a68e-10f0f0f350bf-delete_snapshot" released by "delete_snapshot" :: held 0.539s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-19e13de9-003d-4e2a-adbc-2f1650d84f19-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-19e13de9-003d-4e2a-adbc-2f1650d84f19-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:55 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "cinder-quobyte-19e13de9-003d-4e2a-adbc-2f1650d84f19" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-19e13de9-003d-4e2a-adbc-2f1650d84f19" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[12580e7c-9670-4a36-aa27-6ddb91a0d3db]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19" returned: 0 in 0.148s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-19e13de9-003d-4e2a-adbc-2f1650d84f19" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-quobyte-19e13de9-003d-4e2a-adbc-2f1650d84f19" released by "delete_volume" :: held 0.198s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Created reservations ['54274682-0ad7-454e-a0cc-a064b8d42c14', '949056c0-10c7-4839-88b8-df248022b863', '2933ad33-0c06-44fb-b6b6-fdfed7570816', 'dc08a575-a892-4636-bf33-065d3d899653'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:09:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Deleted volume successfully.
Sep 30 20:09:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-31e776d4-0164-4a64-b84e-ff96e562eb6b tempest-CreateVolumesFromSnapshotTest-831994119 None] Lock "cinder-19e13de9-003d-4e2a-adbc-2f1650d84f19-delete_volume" released by "delete_volume" :: held 0.359s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:09:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:09:56 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-3c6fcb67-5799-4064-b780-94f6f15201ee req-f77d8008-f08b-49b8-b8ef-99ce765cf3a8 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:56 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-3c6fcb67-5799-4064-b780-94f6f15201ee req-f77d8008-f08b-49b8-b8ef-99ce765cf3a8 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:09:56 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-3c6fcb67-5799-4064-b780-94f6f15201ee req-f77d8008-f08b-49b8-b8ef-99ce765cf3a8 tempest-AttachVolumeTestJSON-143237044 None] Terminate volume connection completed successfully.
Sep 30 20:09:56 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-3c6fcb67-5799-4064-b780-94f6f15201ee req-f77d8008-f08b-49b8-b8ef-99ce765cf3a8 tempest-AttachVolumeTestJSON-143237044 None] Deleting attachment d02cee03-611d-406e-a0ba-43a9dd58ba22. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:10:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:10:06 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=93,cinder:INSERT=35,cinder:UPDATE=132,cinder:DELETE=7 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:10:06 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=75,cinder:INSERT=30,cinder:UPDATE=119,cinder:DELETE=14 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:10:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:10:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:10:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-8e1cbf07-8312-484d-a71c-f68239af8b5e req-95cb045b-ffe8-4ef6-8076-3ee1d5a283f0 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-8e1cbf07-8312-484d-a71c-f68239af8b5e req-95cb045b-ffe8-4ef6-8076-3ee1d5a283f0 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-8e1cbf07-8312-484d-a71c-f68239af8b5e req-95cb045b-ffe8-4ef6-8076-3ee1d5a283f0 tempest-AttachVolumeTestJSON-143237044 None] Terminate volume connection completed successfully.
Sep 30 20:10:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-8e1cbf07-8312-484d-a71c-f68239af8b5e req-95cb045b-ffe8-4ef6-8076-3ee1d5a283f0 tempest-AttachVolumeTestJSON-143237044 None] Deleting attachment fd302c59-2205-4b70-ba82-4fbc1f149c4c. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:10:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "cinder-645015c4-656a-43a4-ab7e-e30cb50df14e-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-645015c4-656a-43a4-ab7e-e30cb50df14e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "cinder-quobyte-645015c4-656a-43a4-ab7e-e30cb50df14e" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-quobyte-645015c4-656a-43a4-ab7e-e30cb50df14e" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d883d63-d45e-43b4-a67b-f1cdae9bddf8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e" returned: 0 in 0.136s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-645015c4-656a-43a4-ab7e-e30cb50df14e" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-quobyte-645015c4-656a-43a4-ab7e-e30cb50df14e" released by "delete_volume" :: held 0.194s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Created reservations ['472d6deb-0bbd-40fd-a6c8-0b039c9eb950', 'f13bb1e8-f9e5-4bc4-b4c8-b509271fb7c7', '703ed5be-47e3-4e9a-b310-29acf3a17bc7', 'c332cb45-00d1-4c37-bb2b-1139f11fd62e'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:10:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Deleted volume successfully.
Sep 30 20:10:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-96fc8755-19ca-44ec-9618-1614ceb1206a tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-645015c4-656a-43a4-ab7e-e30cb50df14e-delete_volume" released by "delete_volume" :: held 0.355s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "cinder-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:31 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "cinder-quobyte-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-quobyte-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dfef6c-c58b-4e00-8e8c-1c7469743c03]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39" returned: 0 in 0.154s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-quobyte-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39" released by "delete_volume" :: held 0.211s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Created reservations ['c9181578-7a07-4aa5-b7f1-59c2f054996b', '430c767e-54fc-4ed6-8921-d4ea5f25a382', '8ebb508e-7927-453b-b889-dda080230512', '11f1f82f-cf8f-401b-87c2-6f0116f339ac'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:10:32 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Deleted volume successfully.
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d924bfcc-2d0c-456a-a381-ce5b69645159 tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-092ac643-9cfd-4f7b-b0a3-6be6ab87bd39-delete_volume" released by "delete_volume" :: held 0.364s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "cinder-53019964-12cd-4845-ab42-206e9449cae1-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-53019964-12cd-4845-ab42-206e9449cae1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:32 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "cinder-quobyte-53019964-12cd-4845-ab42-206e9449cae1" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-quobyte-53019964-12cd-4845-ab42-206e9449cae1" acquired by "delete_volume" :: waited 0.018s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61be5e-95f7-48da-9b01-a55947e86926]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-53019964-12cd-4845-ab42-206e9449cae1" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-quobyte-53019964-12cd-4845-ab42-206e9449cae1" released by "delete_volume" :: held 0.182s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Created reservations ['efd60fc2-35af-4bd1-854d-324d5a869dc1', '796f57d0-7169-41bf-8582-0e3a4088198a', '7907c927-f4a0-4e25-8fdb-f97ecafd5c68', 'ceb99c3b-fbb6-43f9-b4ea-97525cccb76c'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:10:33 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Deleted volume successfully.
Sep 30 20:10:33 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0c5bc194-fcfa-4e17-b3f5-c3a15b554a4c tempest-AttachVolumeTestJSON-143237044 None] Lock "cinder-53019964-12cd-4845-ab42-206e9449cae1-delete_volume" released by "delete_volume" :: held 0.359s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:10:37 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Flow 'volume_create_manager' (9b56e196-a24b-4337-a6f9-038ae7bb211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caafa517-878b-4d55-acc8-2eb663256864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caafa517-878b-4d55-acc8-2eb663256864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1099530338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64bd9e25-e9bc-42e2-84d6-9545779f0612,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a869f8b47534403284d0a167ce761ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:10:38Z,use_quota=True,user_id='ce1e23e8b36d48a788b80c0487c8d9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf9dc24-5f31-4877-914a-5d29228929c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bf9dc24-5f31-4877-914a-5d29228929c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e748c3-3f1c-4e1f-9f95-e0d2290868b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e748c3-3f1c-4e1f-9f95-e0d2290868b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64bd9e25-e9bc-42e2-84d6-9545779f0612', 'volume_name': 'volume-64bd9e25-e9bc-42e2-84d6-9545779f0612', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae013cf7-8a12-44bf-adc5-111f257dbe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae013cf7-8a12-44bf-adc5-111f257dbe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607dade2-e6d6-46e7-808f-23f4f841a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:37 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Volume 64bd9e25-e9bc-42e2-84d6-9545779f0612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64bd9e25-e9bc-42e2-84d6-9545779f0612', 'volume_size': 1}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1099530338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64bd9e25-e9bc-42e2-84d6-9545779f0612,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a869f8b47534403284d0a167ce761ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:10:38Z,use_quota=True,user_id='ce1e23e8b36d48a788b80c0487c8d9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Creating volume 64bd9e25-e9bc-42e2-84d6-9545779f0612 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:10:37 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:10:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64bd9e25-e9bc-42e2-84d6-9545779f0612 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:37 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=84, name=volume-64bd9e25-e9bc-42e2-84d6-9545779f0612, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64bd9e25-e9bc-42e2-84d6-9545779f0612 1073741824" returned: 0 in 0.116s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64bd9e25-e9bc-42e2-84d6-9545779f0612 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64bd9e25-e9bc-42e2-84d6-9545779f0612" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] <== create_volume: return (140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.143s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607dade2-e6d6-46e7-808f-23f4f841a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64bd9e25-e9bc-42e2-84d6-9545779f0612', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3249a2c-4838-479f-af4a-7264997825fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:38 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Volume volume-64bd9e25-e9bc-42e2-84d6-9545779f0612 (64bd9e25-e9bc-42e2-84d6-9545779f0612): created successfully
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3249a2c-4838-479f-af4a-7264997825fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Flow 'volume_create_manager' (9b56e196-a24b-4337-a6f9-038ae7bb211f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:10:38 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-e00fd69e-ea9c-4aad-ab32-a176777c84d7 req-4ca7f96e-4855-48d0-9728-409822a9a299 tempest-VolumesGetTestJSON-124997988 None] Created volume successfully.
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Acquiring lock "cinder-64bd9e25-e9bc-42e2-84d6-9545779f0612-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Lock "cinder-64bd9e25-e9bc-42e2-84d6-9545779f0612-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:39 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Acquiring lock "cinder-quobyte-64bd9e25-e9bc-42e2-84d6-9545779f0612" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Lock "cinder-quobyte-64bd9e25-e9bc-42e2-84d6-9545779f0612" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4437f0-7345-4eec-b7be-98e0b3f66909]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64bd9e25-e9bc-42e2-84d6-9545779f0612 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:39 devstack quobyte-client[79699]: System call "lookup" of process 87142 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:10:39 devstack quobyte-client[79699]: System call "getattr" of process 87142 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:10:39 devstack quobyte-client[79699]: System call "open" of process 87142 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64bd9e25-e9bc-42e2-84d6-9545779f0612" returned: 0 in 0.150s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64bd9e25-e9bc-42e2-84d6-9545779f0612 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-64bd9e25-e9bc-42e2-84d6-9545779f0612" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Lock "cinder-quobyte-64bd9e25-e9bc-42e2-84d6-9545779f0612" released by "delete_volume" :: held 0.209s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.quota [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Created reservations ['2b786882-6844-45df-aa98-636d98e309b8', '04c05394-7c2f-4529-be24-1ac446ea1e01', 'a79ed2c1-c86f-4579-9ecf-a8c65e491f5c', 'a8f1768b-c58f-46eb-985f-87360ea61249'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.manager [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:10:39 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Deleted volume successfully.
Sep 30 20:10:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-cdbf9878-b919-4440-a8c9-5e9e484fd7b1 req-4c1bfc95-f0e3-4c48-8b0c-8cdd84c47c2a tempest-VolumesGetTestJSON-124997988 None] Lock "cinder-64bd9e25-e9bc-42e2-84d6-9545779f0612-delete_volume" released by "delete_volume" :: held 0.345s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:10:42 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-09fbba80-c60f-4a4d-8d62-f5c28b5b7550 tempest-GroupSnapshotsV319Test-1958024515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-09fbba80-c60f-4a4d-8d62-f5c28b5b7550 tempest-GroupSnapshotsV319Test-1958024515 None] Group tempest-GroupSnapshotsV319Test-Group-1320554883: creating
Sep 30 20:10:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-09fbba80-c60f-4a4d-8d62-f5c28b5b7550 tempest-GroupSnapshotsV319Test-1958024515 None] Group tempest-GroupSnapshotsV319Test-Group-1320554883: created successfully
Sep 30 20:10:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-09fbba80-c60f-4a4d-8d62-f5c28b5b7550 tempest-GroupSnapshotsV319Test-1958024515 None] Create group completed successfully.
Sep 30 20:10:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Flow 'volume_create_manager' (bed01eac-e21a-4b47-957e-c639cd578b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2daae0b-47b0-45ac-b378-f5a31d687d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2daae0b-47b0-45ac-b378-f5a31d687d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-133451408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f3c69a4-d2ad-41d3-ba80-76791c70f167,host='devstack@QuobyteHD#QuobyteHD',id=3bfaad37-a1e6-4f3e-bf2d-da3a158b3415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62323b4400a84a50822073f3c9f17997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:10:44Z,use_quota=True,user_id='6c7f177db11e4824abb70d75ac90b5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6224b7ca-fddc-4bf3-a16b-34c8a646d1f6),volume_type_id=6224b7ca-fddc-4bf3-a16b-34c8a646d1f6)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5bae94-a9ae-48fe-9b66-adcf911d66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5bae94-a9ae-48fe-9b66-adcf911d66c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28766419-5cc8-46fc-9c31-5d66a89abb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28766419-5cc8-46fc-9c31-5d66a89abb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfaad37-a1e6-4f3e-bf2d-da3a158b3415', 'volume_name': 'volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073642e8-ea8b-4dc7-bef5-28e4d32452e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073642e8-ea8b-4dc7-bef5-28e4d32452e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c57d5a-78da-47df-be4d-43575093fa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:43 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Volume 3bfaad37-a1e6-4f3e-bf2d-da3a158b3415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415', 'volume_size': 1}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f3c69a4-d2ad-41d3-ba80-76791c70f167,created_at=2025-09-30T18:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-133451408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f3c69a4-d2ad-41d3-ba80-76791c70f167,host='devstack@QuobyteHD#QuobyteHD',id=3bfaad37-a1e6-4f3e-bf2d-da3a158b3415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62323b4400a84a50822073f3c9f17997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:10:44Z,use_quota=True,user_id='6c7f177db11e4824abb70d75ac90b5d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6224b7ca-fddc-4bf3-a16b-34c8a646d1f6),volume_type_id=6224b7ca-fddc-4bf3-a16b-34c8a646d1f6)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Creating volume 3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:10:43 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:43 devstack quobyte-client[79699]: System call "lookup" of process 87147 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:10:43 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=85, name=volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 1073741824" returned: 0 in 0.158s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] <== create_volume: return (186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.188s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c57d5a-78da-47df-be4d-43575093fa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ad102e-e339-4124-8ae7-e0c1c7bee480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:43 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Volume volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 (3bfaad37-a1e6-4f3e-bf2d-da3a158b3415): created successfully
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5ad102e-e339-4124-8ae7-e0c1c7bee480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Flow 'volume_create_manager' (bed01eac-e21a-4b47-957e-c639cd578b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:10:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6ab94600-b8cc-4dca-81e9-37879f19d994 tempest-GroupSnapshotsV319Test-1958024515 None] Created volume successfully.
Sep 30 20:10:44 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] GroupSnapshot 28922fc9-7eeb-4772-817a-256962841609: creating.
Sep 30 20:10:44 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:44 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Group snapshot 28922fc9-7eeb-4772-817a-256962841609: creating. {{(pid=79893) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 30 20:10:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Creating offline snapshot 0d36483b-24a1-43d0-ad84-c0c136e62952 of volume 3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:10:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d356e1-54d4-4887-ba8a-6f931a08e649]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" returned: 0 in 0.156s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:45 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=86, name=volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 1G" returned: 0 in 0.097s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] CMD "qemu-img rebase -u -b volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952" returned: 0 in 0.048s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.info" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.info" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.422s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:45 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e7ba8144-00e4-48d3-a85f-d1a9b2265dbe tempest-GroupSnapshotsV319Test-1958024515 None] group_snapshot 28922fc9-7eeb-4772-817a-256962841609: created successfully
Sep 30 20:10:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] group_snapshot 28922fc9-7eeb-4772-817a-256962841609: deleting
Sep 30 20:10:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] group_snapshot 28922fc9-7eeb-4772-817a-256962841609: deleting {{(pid=79893) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Acquiring lock "cinder-quobyte-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "cinder-quobyte-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" acquired by "delete_snapshot" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Acquiring lock "cinder-quobyte-0d36483b-24a1-43d0-ad84-c0c136e62952" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "cinder-quobyte-0d36483b-24a1-43d0-ad84-c0c136e62952" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Deleting offline snapshot 0d36483b-24a1-43d0-ad84-c0c136e62952 of volume 3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] snapshot_file for this snap is: volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[869a9b7f-6714-4c77-8069-fc3e9615e79c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952" returned: 0 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dfbfc9-88be-499f-ba2e-0e091e161126]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:46 devstack quobyte-client[79699]: System call "getattr" of process 87167 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" returned: 0 in 0.150s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952" returned: 0 in 0.077s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415.0d36483b-24a1-43d0-ad84-c0c136e62952" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "cinder-quobyte-0d36483b-24a1-43d0-ad84-c0c136e62952" released by "_delete_snapshot" :: held 0.482s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "cinder-quobyte-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" released by "delete_snapshot" :: held 0.492s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:46 devstack cinder-volume[79893]: WARNING cinder.quota [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2086438895 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2086438895, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:10:46 devstack cinder-volume[79893]: WARNING cinder.quota [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2086438895 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2086438895, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:10:46 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] Created reservations ['8aacb554-07cd-4a6f-8591-4d7802fe961a', 'd17dc31f-0976-48b5-834b-30a241a200d0', '6e5204b5-f987-4eaa-aaef-0ec7e1d9e8bb', '12cc3a87-df17-4284-aa07-8ffb98acb3a9'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0bd6d86c-88b9-4318-a359-8f447e49d499 tempest-GroupSnapshotsV319Test-1958024515 None] group_snapshot 28922fc9-7eeb-4772-817a-256962841609: deleted successfully
Sep 30 20:10:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Acquiring lock "cinder-quobyte-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "cinder-quobyte-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d24a68-3838-4ea1-8023-c41186c80800]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:47 devstack quobyte-client[79699]: System call "getattr" of process 87175 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" returned: 0 in 0.148s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "cinder-quobyte-3bfaad37-a1e6-4f3e-bf2d-da3a158b3415" released by "delete_volume" :: held 0.195s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Created reservations ['bc0a474e-542a-48e9-9b82-f1ca00b3ad98'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:47 devstack cinder-volume[79893]: WARNING cinder.quota [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2086438895 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2086438895, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Created reservations ['c6dddd28-9254-4d3a-818f-de6e2069acaa', '10dc668c-cde3-485d-aebc-d1b35f96f8ca', '625d43f7-7ba2-4404-b405-9baa062a3cf5', '6805ef6f-5906-4573-ab12-1a8433450b42'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:47 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:10:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c27ee668-9b82-4fb1-90a3-4a44812f7cc9 tempest-GroupSnapshotsV319Test-1958024515 None] Delete group completed successfully.
Sep 30 20:10:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:10:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-57506489-b51a-47b2-aede-9f1a7948d608 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-57506489-b51a-47b2-aede-9f1a7948d608 tempest-GroupsTest-846668258 None] Group tempest-Group1-1456353188: creating
Sep 30 20:10:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-57506489-b51a-47b2-aede-9f1a7948d608 tempest-GroupsTest-846668258 None] Group tempest-Group1-1456353188: created successfully
Sep 30 20:10:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-57506489-b51a-47b2-aede-9f1a7948d608 tempest-GroupsTest-846668258 None] Create group completed successfully.
Sep 30 20:10:55 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-60cc33b5-7186-45ab-8c29-ee9e575d3c7d tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-60cc33b5-7186-45ab-8c29-ee9e575d3c7d tempest-GroupsTest-846668258 None] Group tempest-Group2-946710895: creating
Sep 30 20:10:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-60cc33b5-7186-45ab-8c29-ee9e575d3c7d tempest-GroupsTest-846668258 None] Group tempest-Group2-946710895: created successfully
Sep 30 20:10:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-60cc33b5-7186-45ab-8c29-ee9e575d3c7d tempest-GroupsTest-846668258 None] Create group completed successfully.
Sep 30 20:10:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:10:57 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Flow 'volume_create_manager' (8d163952-f51f-49aa-bba5-4c8442b61bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7164f9-7cc8-41d4-a14a-fd5d14e40d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7164f9-7cc8-41d4-a14a-fd5d14e40d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945785874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e5bff0fc-6cbf-4e37-be11-d828a5586be6,host='devstack@QuobyteHD#QuobyteHD',id=640f72dd-0130-451a-9cb1-381167c6b0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37551671bc08485386873f65d6d7f0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:10:57Z,use_quota=True,user_id='673f5a2c3d074370bbd75b8146681f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b12d913-6e59-4db3-aa2c-ad3430d048c1),volume_type_id=7b12d913-6e59-4db3-aa2c-ad3430d048c1)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25d2ca6-5576-47a7-9e90-74f0b77805fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25d2ca6-5576-47a7-9e90-74f0b77805fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b14009-bada-4422-9954-059f297aa75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b14009-bada-4422-9954-059f297aa75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640f72dd-0130-451a-9cb1-381167c6b0d0', 'volume_name': 'volume-640f72dd-0130-451a-9cb1-381167c6b0d0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5766cc3-61fe-4e0d-8a87-a76d8a7969c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5766cc3-61fe-4e0d-8a87-a76d8a7969c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5488ea72-8739-4c3e-beb5-caaa591e9c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:57 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Volume 640f72dd-0130-451a-9cb1-381167c6b0d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640f72dd-0130-451a-9cb1-381167c6b0d0', 'volume_size': 1}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e5bff0fc-6cbf-4e37-be11-d828a5586be6,created_at=2025-09-30T18:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945785874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e5bff0fc-6cbf-4e37-be11-d828a5586be6,host='devstack@QuobyteHD#QuobyteHD',id=640f72dd-0130-451a-9cb1-381167c6b0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37551671bc08485386873f65d6d7f0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:10:57Z,use_quota=True,user_id='673f5a2c3d074370bbd75b8146681f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b12d913-6e59-4db3-aa2c-ad3430d048c1),volume_type_id=7b12d913-6e59-4db3-aa2c-ad3430d048c1)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Creating volume 640f72dd-0130-451a-9cb1-381167c6b0d0 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:10:57 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-640f72dd-0130-451a-9cb1-381167c6b0d0 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:57 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=88, name=volume-640f72dd-0130-451a-9cb1-381167c6b0d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-640f72dd-0130-451a-9cb1-381167c6b0d0 1073741824" returned: 0 in 0.115s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-640f72dd-0130-451a-9cb1-381167c6b0d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-640f72dd-0130-451a-9cb1-381167c6b0d0" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] <== create_volume: return (139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.142s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5488ea72-8739-4c3e-beb5-caaa591e9c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640f72dd-0130-451a-9cb1-381167c6b0d0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d318c37-53e5-428e-91e5-3b0426c6e07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:10:57 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Volume volume-640f72dd-0130-451a-9cb1-381167c6b0d0 (640f72dd-0130-451a-9cb1-381167c6b0d0): created successfully
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d318c37-53e5-428e-91e5-3b0426c6e07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:10:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Flow 'volume_create_manager' (8d163952-f51f-49aa-bba5-4c8442b61bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:10:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-19bca7f4-6165-4c62-8868-08ee923a3f17 tempest-GroupsTest-846668258 None] Created volume successfully.
Sep 30 20:10:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Acquiring lock "cinder-quobyte-640f72dd-0130-451a-9cb1-381167c6b0d0" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:10:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Lock "cinder-quobyte-640f72dd-0130-451a-9cb1-381167c6b0d0" acquired by "delete_volume" :: waited 0.020s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:10:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae609b2e-5d3c-47f1-88c9-d1fa8bf8b19b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:10:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-640f72dd-0130-451a-9cb1-381167c6b0d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:58 devstack quobyte-client[79699]: System call "open" of process 87224 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:10:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-640f72dd-0130-451a-9cb1-381167c6b0d0" returned: 0 in 0.254s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-640f72dd-0130-451a-9cb1-381167c6b0d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-640f72dd-0130-451a-9cb1-381167c6b0d0" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Lock "cinder-quobyte-640f72dd-0130-451a-9cb1-381167c6b0d0" released by "delete_volume" :: held 0.322s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Created reservations ['5e922718-2476-4bae-bfcf-2af1c49a5b7e'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:59 devstack cinder-volume[79893]: WARNING cinder.quota [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1216634806 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1216634806, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:10:59 devstack cinder-volume[79893]: WARNING cinder.quota [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1216634806 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1216634806, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Created reservations ['19b7676d-4759-4081-8f93-630cf7e01e9b', 'cdcb77dd-da9e-4159-b60d-6cd313a89924', 'f2237bc6-2e88-457f-a222-36b47bccfe1f', 'e9458b89-966a-4186-a9e6-5cfd29e499b7'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:10:59 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d37bac7d-e140-4048-a1fa-043b7b838074 tempest-GroupsTest-846668258 None] Delete group completed successfully.
Sep 30 20:10:59 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Created reservations ['b00d0bf1-b30f-431a-9a55-dc96355eabcb'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:10:59 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:10:59 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-fea9e4ee-9f05-49ce-9f35-0615d14a4444 tempest-GroupsTest-846668258 None] Delete group completed successfully.
Sep 30 20:11:01 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5e7a7461-179f-4e1b-9d25-82b36dc4f0d8 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:01 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5e7a7461-179f-4e1b-9d25-82b36dc4f0d8 tempest-GroupsTest-846668258 None] Group tempest-GroupsTest-Group-565550452: creating
Sep 30 20:11:01 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5e7a7461-179f-4e1b-9d25-82b36dc4f0d8 tempest-GroupsTest-846668258 None] Group tempest-GroupsTest-Group-565550452: created successfully
Sep 30 20:11:01 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5e7a7461-179f-4e1b-9d25-82b36dc4f0d8 tempest-GroupsTest-846668258 None] Create group completed successfully.
Sep 30 20:11:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Flow 'volume_create_manager' (76a5aa59-2332-4237-8590-fb37e1f264f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44d151e-e07b-4163-84c7-579e53e4253e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44d151e-e07b-4163-84c7-579e53e4253e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667395284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=088e1525-eb60-4dd9-89fd-5c6c941f4676,host='devstack@QuobyteHD#QuobyteHD',id=4b2cb40f-3820-44e6-99b9-2d851ee37f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37551671bc08485386873f65d6d7f0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:03Z,use_quota=True,user_id='673f5a2c3d074370bbd75b8146681f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42d918a6-5ce1-4964-8998-8fb43b9da14f),volume_type_id=42d918a6-5ce1-4964-8998-8fb43b9da14f)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce545a6-e6d2-4899-b406-48c36c72704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce545a6-e6d2-4899-b406-48c36c72704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d24180-4846-469c-945f-01363317ab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d24180-4846-469c-945f-01363317ab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b2cb40f-3820-44e6-99b9-2d851ee37f5e', 'volume_name': 'volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce83e865-0b60-47f8-bea6-222e2ce7e953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce83e865-0b60-47f8-bea6-222e2ce7e953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8d616f-dfec-4262-ae7d-2f9c7c3accf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:02 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Volume 4b2cb40f-3820-44e6-99b9-2d851ee37f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e', 'volume_size': 1}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=088e1525-eb60-4dd9-89fd-5c6c941f4676,created_at=2025-09-30T18:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1667395284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=088e1525-eb60-4dd9-89fd-5c6c941f4676,host='devstack@QuobyteHD#QuobyteHD',id=4b2cb40f-3820-44e6-99b9-2d851ee37f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37551671bc08485386873f65d6d7f0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:03Z,use_quota=True,user_id='673f5a2c3d074370bbd75b8146681f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42d918a6-5ce1-4964-8998-8fb43b9da14f),volume_type_id=42d918a6-5ce1-4964-8998-8fb43b9da14f)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Creating volume 4b2cb40f-3820-44e6-99b9-2d851ee37f5e {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:11:02 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:02 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=89, name=volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:11:02 devstack quobyte-client[79699]: System call "getattr" of process 87246 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:11:02 devstack quobyte-client[79699]: System call "lookup" of process 87246 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:11:02 devstack quobyte-client[79699]: System call "getattr" of process 87246 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e 1073741824" returned: 0 in 0.113s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] <== create_volume: return (138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.141s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e8d616f-dfec-4262-ae7d-2f9c7c3accf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b992a0f-f9e5-44f5-ab24-4ef37bb91a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:02 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Volume volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e (4b2cb40f-3820-44e6-99b9-2d851ee37f5e): created successfully
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b992a0f-f9e5-44f5-ab24-4ef37bb91a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Flow 'volume_create_manager' (76a5aa59-2332-4237-8590-fb37e1f264f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:02 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-cdcc316f-bddc-42c2-a96f-fa4391359da4 tempest-GroupsTest-846668258 None] Created volume successfully.
Sep 30 20:11:04 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Flow 'volume_create_manager' (4498538b-cbbf-4014-ace6-1c20f5b8e2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d44d82-b4da-4609-9dff-6ada333e266f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d44d82-b4da-4609-9dff-6ada333e266f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393368984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=088e1525-eb60-4dd9-89fd-5c6c941f4676,host='devstack@QuobyteHD#QuobyteHD',id=08d6cc5a-3747-41cb-a968-73f57d9578ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37551671bc08485386873f65d6d7f0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:04Z,use_quota=True,user_id='673f5a2c3d074370bbd75b8146681f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42d918a6-5ce1-4964-8998-8fb43b9da14f),volume_type_id=42d918a6-5ce1-4964-8998-8fb43b9da14f)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35c0a8b-ed60-4069-a0b3-0dcbb3160954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35c0a8b-ed60-4069-a0b3-0dcbb3160954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3723901d-70d3-4ac8-9fae-39aafe7b6e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3723901d-70d3-4ac8-9fae-39aafe7b6e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d6cc5a-3747-41cb-a968-73f57d9578ab', 'volume_name': 'volume-08d6cc5a-3747-41cb-a968-73f57d9578ab', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beae2fda-6e05-4127-adaa-4bc5366ca457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beae2fda-6e05-4127-adaa-4bc5366ca457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ee4ff0-98dd-4996-bd8f-427809d5ba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:04 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Volume 08d6cc5a-3747-41cb-a968-73f57d9578ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d6cc5a-3747-41cb-a968-73f57d9578ab', 'volume_size': 1}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=088e1525-eb60-4dd9-89fd-5c6c941f4676,created_at=2025-09-30T18:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393368984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=088e1525-eb60-4dd9-89fd-5c6c941f4676,host='devstack@QuobyteHD#QuobyteHD',id=08d6cc5a-3747-41cb-a968-73f57d9578ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37551671bc08485386873f65d6d7f0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:04Z,use_quota=True,user_id='673f5a2c3d074370bbd75b8146681f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42d918a6-5ce1-4964-8998-8fb43b9da14f),volume_type_id=42d918a6-5ce1-4964-8998-8fb43b9da14f)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Creating volume 08d6cc5a-3747-41cb-a968-73f57d9578ab {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:11:04 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08d6cc5a-3747-41cb-a968-73f57d9578ab 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:04 devstack quobyte-client[79699]: System call "getlk" of process 87250 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:11:04 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=90, name=volume-08d6cc5a-3747-41cb-a968-73f57d9578ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:11:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08d6cc5a-3747-41cb-a968-73f57d9578ab 1073741824" returned: 0 in 0.114s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08d6cc5a-3747-41cb-a968-73f57d9578ab {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08d6cc5a-3747-41cb-a968-73f57d9578ab" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] <== create_volume: return (140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.142s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ee4ff0-98dd-4996-bd8f-427809d5ba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d6cc5a-3747-41cb-a968-73f57d9578ab', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3b627b-48a4-4fda-9309-db79955512cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:04 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Volume volume-08d6cc5a-3747-41cb-a968-73f57d9578ab (08d6cc5a-3747-41cb-a968-73f57d9578ab): created successfully
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3b627b-48a4-4fda-9309-db79955512cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Flow 'volume_create_manager' (4498538b-cbbf-4014-ace6-1c20f5b8e2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:04 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-844f21e3-52d6-4bb8-b5e6-dee5c9f41742 tempest-GroupsTest-846668258 None] Created volume successfully.
Sep 30 20:11:05 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-9520d665-b113-4886-8390-12bd91dd1a42 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:05 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-9520d665-b113-4886-8390-12bd91dd1a42 tempest-GroupsTest-846668258 None] Update group completed successfully.
Sep 30 20:11:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-a6ab2744-af38-48a5-8c7b-a8078e70c7c9 req-8c9701ed-c25a-43c7-bedb-0190f03ad3c6 tempest-TaggedAttachmentsTest-827156841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-a6ab2744-af38-48a5-8c7b-a8078e70c7c9 req-8c9701ed-c25a-43c7-bedb-0190f03ad3c6 tempest-TaggedAttachmentsTest-827156841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb437533-d630-45b7-ab1d-039ee6b8e12a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:11:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-a6ab2744-af38-48a5-8c7b-a8078e70c7c9 req-8c9701ed-c25a-43c7-bedb-0190f03ad3c6 tempest-TaggedAttachmentsTest-827156841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-a6ab2744-af38-48a5-8c7b-a8078e70c7c9 req-8c9701ed-c25a-43c7-bedb-0190f03ad3c6 tempest-TaggedAttachmentsTest-827156841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d" returned: 0 in 0.134s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-a6ab2744-af38-48a5-8c7b-a8078e70c7c9 req-8c9701ed-c25a-43c7-bedb-0190f03ad3c6 tempest-TaggedAttachmentsTest-827156841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.145s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-a6ab2744-af38-48a5-8c7b-a8078e70c7c9 req-8c9701ed-c25a-43c7-bedb-0190f03ad3c6 tempest-TaggedAttachmentsTest-827156841 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-07271548-fdf0-4933-9ca6-f2794b24e00d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d1b09ed-eb3d-4313-8101-9ae5654ca1f1', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:11:05 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-a6ab2744-af38-48a5-8c7b-a8078e70c7c9 req-8c9701ed-c25a-43c7-bedb-0190f03ad3c6 tempest-TaggedAttachmentsTest-827156841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:05 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-a6ab2744-af38-48a5-8c7b-a8078e70c7c9 req-8c9701ed-c25a-43c7-bedb-0190f03ad3c6 tempest-TaggedAttachmentsTest-827156841 None] attachment_update completed successfully.
Sep 30 20:11:06 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0048d601-635f-49c9-9d35-84ea00eb8499 tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0048d601-635f-49c9-9d35-84ea00eb8499 tempest-GroupsTest-846668258 None] Update group completed successfully.
Sep 30 20:11:07 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Acquiring lock "cinder-quobyte-08d6cc5a-3747-41cb-a968-73f57d9578ab" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Lock "cinder-quobyte-08d6cc5a-3747-41cb-a968-73f57d9578ab" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afaef42-66a8-4c0a-abcd-9c5b3fd69187]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08d6cc5a-3747-41cb-a968-73f57d9578ab {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08d6cc5a-3747-41cb-a968-73f57d9578ab" returned: 0 in 0.141s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08d6cc5a-3747-41cb-a968-73f57d9578ab {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08d6cc5a-3747-41cb-a968-73f57d9578ab" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Lock "cinder-quobyte-08d6cc5a-3747-41cb-a968-73f57d9578ab" released by "delete_volume" :: held 0.183s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Acquiring lock "cinder-quobyte-4b2cb40f-3820-44e6-99b9-2d851ee37f5e" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Lock "cinder-quobyte-4b2cb40f-3820-44e6-99b9-2d851ee37f5e" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae38daa-ae8b-4978-b272-317af173d1c7]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:11:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e" returned: 0 in 0.141s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4b2cb40f-3820-44e6-99b9-2d851ee37f5e" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Lock "cinder-quobyte-4b2cb40f-3820-44e6-99b9-2d851ee37f5e" released by "delete_volume" :: held 0.180s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Created reservations ['2f46d2d1-c752-4a97-9ed2-9bda300b8ec8'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:11:08 devstack cinder-volume[79893]: WARNING cinder.quota [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-558838473 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-558838473, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:11:08 devstack cinder-volume[79893]: WARNING cinder.quota [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-558838473 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-558838473, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Created reservations ['9cf9923e-129d-4cd1-bfad-4254ac8a4efe', 'db15c025-8e10-40e7-a203-62133f505e4a', 'f7641ef2-d228-4a87-b1d3-38ad337faa38', 'bcdf23ce-6135-45a6-9696-3060b1094d54'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Created reservations ['6b4ef5b6-8d39-49fc-8d4f-4f406a9ec2df', 'ad1bb769-b9ee-4c1e-a407-ee4e175d4683', '26d75f5c-b329-4f24-8b58-5c259248e36d', '271f687f-3053-4d7e-9c7a-55061cabb198'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:08 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:11:08 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-eb61fed4-25b5-422f-9492-9445ba0e769c tempest-GroupsTest-846668258 None] Delete group completed successfully.
Sep 30 20:11:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:11:11 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b74563eb-393c-4ba5-af08-434c326cc1bc tempest-GroupsV320Test-1208053019 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:11 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b74563eb-393c-4ba5-af08-434c326cc1bc tempest-GroupsV320Test-1208053019 None] Group tempest-GroupsV320Test-Group-377841687: creating
Sep 30 20:11:12 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b74563eb-393c-4ba5-af08-434c326cc1bc tempest-GroupsV320Test-1208053019 None] Group tempest-GroupsV320Test-Group-377841687: created successfully
Sep 30 20:11:12 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b74563eb-393c-4ba5-af08-434c326cc1bc tempest-GroupsV320Test-1208053019 None] Create group completed successfully.
Sep 30 20:11:13 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Created reservations ['48c3f3c0-0ccc-4bf0-8d86-02f2675c1413'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:13 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:11:13 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6f48552d-3158-484d-b112-5afacafd5dd6 tempest-GroupsV320Test-1208053019 None] Delete group completed successfully.
Sep 30 20:11:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:11:23 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=93,cinder:UPDATE=121,cinder:INSERT=20,cinder:DELETE=6 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:11:23 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=103,cinder:INSERT=21,cinder:UPDATE=86,cinder:DELETE=3 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:11:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:11:33 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-27673d3e-68b7-401f-a50f-65c7b4da0959 req-4b964296-af39-425c-8fc4-084fd2bc619e tempest-TaggedAttachmentsTest-827156841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:33 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-27673d3e-68b7-401f-a50f-65c7b4da0959 req-4b964296-af39-425c-8fc4-084fd2bc619e tempest-TaggedAttachmentsTest-827156841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:33 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-27673d3e-68b7-401f-a50f-65c7b4da0959 req-4b964296-af39-425c-8fc4-084fd2bc619e tempest-TaggedAttachmentsTest-827156841 None] Terminate volume connection completed successfully.
Sep 30 20:11:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-27673d3e-68b7-401f-a50f-65c7b4da0959 req-4b964296-af39-425c-8fc4-084fd2bc619e tempest-TaggedAttachmentsTest-827156841 None] Deleting attachment 5d1b09ed-eb3d-4313-8101-9ae5654ca1f1. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:11:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:11:35 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Flow 'volume_create_manager' (61e91d3b-52b9-406f-bd08-346a9140b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010d8656-7c4a-4f99-86bd-9c8244db82d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010d8656-7c4a-4f99-86bd-9c8244db82d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-870051194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bce8a3-9434-4db8-a0e4-1ce4c690c3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4674859f0b964b5b83767e9da85cb9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:36Z,use_quota=True,user_id='eb7a1b995e2a4e8eb07db7c1e690f606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b2c93f-c39a-4c09-88f9-330660975567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b2c93f-c39a-4c09-88f9-330660975567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333a8165-5ce9-4825-a308-f08a9336c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333a8165-5ce9-4825-a308-f08a9336c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58bce8a3-9434-4db8-a0e4-1ce4c690c3aa', 'volume_name': 'volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d68264-15c8-45c6-a8ef-4f875949a1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d68264-15c8-45c6-a8ef-4f875949a1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b532f7-1cfb-45d9-8bd4-464d9c1934c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Volume 58bce8a3-9434-4db8-a0e4-1ce4c690c3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa', 'volume_size': 1}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-870051194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58bce8a3-9434-4db8-a0e4-1ce4c690c3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4674859f0b964b5b83767e9da85cb9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:36Z,use_quota=True,user_id='eb7a1b995e2a4e8eb07db7c1e690f606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Creating volume 58bce8a3-9434-4db8-a0e4-1ce4c690c3aa {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:11:35 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:35 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=91, name=volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa 1073741824" returned: 0 in 0.238s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] <== create_volume: return (264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.266s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b532f7-1cfb-45d9-8bd4-464d9c1934c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dc291b-b56a-42fd-8e8d-69d684095d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Volume volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa (58bce8a3-9434-4db8-a0e4-1ce4c690c3aa): created successfully
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dc291b-b56a-42fd-8e8d-69d684095d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Flow 'volume_create_manager' (61e91d3b-52b9-406f-bd08-346a9140b34e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-844332bd-bb93-4391-b9b5-807d3dc10c45 tempest-VolumesListAdminTestJSON-2037050134 None] Created volume successfully.
Sep 30 20:11:36 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:36 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:11:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Flow 'volume_create_manager' (2eea30f0-8809-4e1b-9390-7b4dea72b348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd41eac2-81b4-4d54-83a6-9184056238e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd41eac2-81b4-4d54-83a6-9184056238e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1286864238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe2fe13-c4a2-4990-bd73-b4627c2809cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4674859f0b964b5b83767e9da85cb9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:37Z,use_quota=True,user_id='eb7a1b995e2a4e8eb07db7c1e690f606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2dad74-749a-4b44-9ea7-3f4c1f5dd9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2dad74-749a-4b44-9ea7-3f4c1f5dd9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a942fd-72be-4496-ae12-1346ccb4b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a942fd-72be-4496-ae12-1346ccb4b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe2fe13-c4a2-4990-bd73-b4627c2809cc', 'volume_name': 'volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0efc50-a00f-4a85-a397-61043b3dc6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0efc50-a00f-4a85-a397-61043b3dc6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cf944f-548a-4e56-96b7-3e25267debd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:37 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Volume cfe2fe13-c4a2-4990-bd73-b4627c2809cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc', 'volume_size': 1}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1286864238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe2fe13-c4a2-4990-bd73-b4627c2809cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4674859f0b964b5b83767e9da85cb9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:37Z,use_quota=True,user_id='eb7a1b995e2a4e8eb07db7c1e690f606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Creating volume cfe2fe13-c4a2-4990-bd73-b4627c2809cc {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:11:37 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:37 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=92, name=volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc 1073741824" returned: 0 in 0.146s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] <== create_volume: return (173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.176s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cf944f-548a-4e56-96b7-3e25267debd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3464107e-8227-4b1f-9adb-925e9ada9849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:37 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Volume volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc (cfe2fe13-c4a2-4990-bd73-b4627c2809cc): created successfully
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3464107e-8227-4b1f-9adb-925e9ada9849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Flow 'volume_create_manager' (2eea30f0-8809-4e1b-9390-7b4dea72b348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:37 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7c46ce81-1339-4ce5-9b01-700f1bbffad8 tempest-VolumesListAdminTestJSON-2037050134 None] Created volume successfully.
Sep 30 20:11:38 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Flow 'volume_create_manager' (bd5565f1-1eac-4d42-a1ef-a2d0b23d8ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506dce24-bd5b-42ea-8bb5-73103ea318f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506dce24-bd5b-42ea-8bb5-73103ea318f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1028337688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4674859f0b964b5b83767e9da85cb9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:38Z,use_quota=True,user_id='eb7a1b995e2a4e8eb07db7c1e690f606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403de554-00f2-4024-9298-01a9e481e2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403de554-00f2-4024-9298-01a9e481e2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d356b3-4c21-4229-bb7a-f068116d9142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d356b3-4c21-4229-bb7a-f068116d9142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa', 'volume_name': 'volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98a2e00-363c-4e11-bfbb-e75dcc1286d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98a2e00-363c-4e11-bfbb-e75dcc1286d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0b0ca8-af6d-4603-8480-f665b6aa4a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:38 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Volume d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa', 'volume_size': 1}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1028337688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4674859f0b964b5b83767e9da85cb9a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:38Z,use_quota=True,user_id='eb7a1b995e2a4e8eb07db7c1e690f606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Creating volume d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:11:38 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:38 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=93, name=volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:11:38 devstack quobyte-client[79699]: System call "getattr" of process 87781 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:11:38 devstack quobyte-client[79699]: System call "open" of process 87781 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa 1073741824" returned: 0 in 0.132s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] <== create_volume: return (156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.158s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0b0ca8-af6d-4603-8480-f665b6aa4a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db6f4e2-f5d9-403c-bc13-c331a4d95cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:38 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Volume volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa (d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa): created successfully
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db6f4e2-f5d9-403c-bc13-c331a4d95cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Flow 'volume_create_manager' (bd5565f1-1eac-4d42-a1ef-a2d0b23d8ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:38 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8edd591e-82ca-4d3e-a10f-8cc052ab0c21 tempest-VolumesListAdminTestJSON-2037050134 None] Created volume successfully.
Sep 30 20:11:39 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Flow 'volume_create_manager' (6b1e94c7-1991-4ecb-96fa-86f5b6baaf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6254f00-e54d-4fbd-adb6-1ff8071137e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6254f00-e54d-4fbd-adb6-1ff8071137e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361250fc-051d-425b-934a-e2b0a15960d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8629a7b49ffa47ddb140c67d40960f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:40Z,use_quota=True,user_id='4f4ea1f4246044ceaf1eb2f7e9ef04e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e4cceb-c5ea-4f93-af27-a8ca53873652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e4cceb-c5ea-4f93-af27-a8ca53873652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a377b261-dbe2-42a4-9ebf-2f9cd90259b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a377b261-dbe2-42a4-9ebf-2f9cd90259b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361250fc-051d-425b-934a-e2b0a15960d8', 'volume_name': 'volume-361250fc-051d-425b-934a-e2b0a15960d8', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cec18c4-e979-4f35-95db-83cb740f8bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cec18c4-e979-4f35-95db-83cb740f8bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34c53ac-d259-4b4d-86ac-6bbcb3b81a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:39 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Volume 361250fc-051d-425b-934a-e2b0a15960d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361250fc-051d-425b-934a-e2b0a15960d8', 'volume_size': 1}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361250fc-051d-425b-934a-e2b0a15960d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8629a7b49ffa47ddb140c67d40960f9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:11:40Z,use_quota=True,user_id='4f4ea1f4246044ceaf1eb2f7e9ef04e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Creating volume 361250fc-051d-425b-934a-e2b0a15960d8 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:11:39 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-361250fc-051d-425b-934a-e2b0a15960d8 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:39 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=94, name=volume-361250fc-051d-425b-934a-e2b0a15960d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:11:39 devstack quobyte-client[79699]: System call "getattr" of process 87786 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-361250fc-051d-425b-934a-e2b0a15960d8 1073741824" returned: 0 in 0.119s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-361250fc-051d-425b-934a-e2b0a15960d8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-361250fc-051d-425b-934a-e2b0a15960d8" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] <== create_volume: return (146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.149s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34c53ac-d259-4b4d-86ac-6bbcb3b81a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361250fc-051d-425b-934a-e2b0a15960d8', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f3efdc-cc84-4e2a-bc8c-0aefd3b92439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:11:39 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Volume volume-361250fc-051d-425b-934a-e2b0a15960d8 (361250fc-051d-425b-934a-e2b0a15960d8): created successfully
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f3efdc-cc84-4e2a-bc8c-0aefd3b92439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:11:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Flow 'volume_create_manager' (6b1e94c7-1991-4ecb-96fa-86f5b6baaf8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:11:39 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f65f976a-c1d9-4f94-a5a4-0ad64ad7b439 tempest-VolumesListAdminTestJSON-1677958822 None] Created volume successfully.
Sep 30 20:11:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Acquiring lock "cinder-361250fc-051d-425b-934a-e2b0a15960d8-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "cinder-361250fc-051d-425b-934a-e2b0a15960d8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Acquiring lock "cinder-quobyte-361250fc-051d-425b-934a-e2b0a15960d8" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "cinder-quobyte-361250fc-051d-425b-934a-e2b0a15960d8" acquired by "delete_volume" :: waited 0.015s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:40 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a1f4be-3c08-4651-9bb6-be61bfc3cdee]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:11:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-361250fc-051d-425b-934a-e2b0a15960d8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "cinder-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:41 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "cinder-quobyte-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-quobyte-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8b9739-b126-4027-9697-d657cf5caec7]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-361250fc-051d-425b-934a-e2b0a15960d8" returned: 0 in 0.162s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-361250fc-051d-425b-934a-e2b0a15960d8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-361250fc-051d-425b-934a-e2b0a15960d8" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "cinder-quobyte-361250fc-051d-425b-934a-e2b0a15960d8" released by "delete_volume" :: held 0.204s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Created reservations ['8ddf6518-e2b5-4b28-91c3-244ae2819ee4', '3e038bfc-015e-41c1-8128-b4a60a2ca4d2', '3dd61b86-466f-4a4c-9bd0-5591494dc133', '15589238-86f9-4981-bc1c-576f3e34e186'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa" returned: 0 in 0.146s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-quobyte-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa" released by "delete_volume" :: held 0.208s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:11:41 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Deleted volume successfully.
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Created reservations ['90f16628-9fed-43ce-a562-6eedf83daebd', '458df12f-448c-40e4-9660-61f174dc16c3', '6f5eae39-b1c0-4c75-ad3f-89992c2035c2', '099a0944-00cf-4228-a613-18564cbb906c'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-bfbd43e7-750e-42de-93d0-c675a76bff27 tempest-VolumesListAdminTestJSON-1677958822 None] Lock "cinder-361250fc-051d-425b-934a-e2b0a15960d8-delete_volume" released by "delete_volume" :: held 0.417s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:11:41 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Deleted volume successfully.
Sep 30 20:11:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-b6de4f5e-fd45-4b3c-92c1-0ea96daf1680 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-d4b4a4c0-49de-4e45-9cf4-f5e15c8ae6aa-delete_volume" released by "delete_volume" :: held 0.396s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "cinder-cfe2fe13-c4a2-4990-bd73-b4627c2809cc-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-cfe2fe13-c4a2-4990-bd73-b4627c2809cc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:42 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "cinder-quobyte-cfe2fe13-c4a2-4990-bd73-b4627c2809cc" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-quobyte-cfe2fe13-c4a2-4990-bd73-b4627c2809cc" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51e0730-d0a7-49c9-a788-2746ed828d8f]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc" returned: 0 in 0.130s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cfe2fe13-c4a2-4990-bd73-b4627c2809cc" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-quobyte-cfe2fe13-c4a2-4990-bd73-b4627c2809cc" released by "delete_volume" :: held 0.173s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Created reservations ['4a7cd99f-cb21-4f9d-9e20-4b6025ea68f9', 'e65b6e2c-d59b-4054-92a6-307feef9d9de', 'b0b11dc8-9421-4918-a005-4c9b14eadeb0', 'aba7aed6-6bd6-4145-99c8-e3d0174cae41'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:11:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Deleted volume successfully.
Sep 30 20:11:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-868c0c0b-ffa4-4ef6-961b-77b9edec14a0 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-cfe2fe13-c4a2-4990-bd73-b4627c2809cc-delete_volume" released by "delete_volume" :: held 0.331s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "cinder-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "cinder-quobyte-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-quobyte-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa" acquired by "delete_volume" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e3300d-17ac-4751-b397-027b3735477e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa" returned: 0 in 0.142s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-quobyte-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa" released by "delete_volume" :: held 0.191s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Created reservations ['997f6609-6bb3-4970-843f-72bf5e90c901', 'b497772d-3429-4fc4-b88f-310d947df51f', '59268b0e-01be-4dea-b095-2fdd81f46059', '1a7ad9a5-9c25-4854-b2aa-4b2839cafb99'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:11:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Deleted volume successfully.
Sep 30 20:11:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-937a8723-1488-4a9b-9c3a-f2c0afb4c4c3 tempest-VolumesListAdminTestJSON-2037050134 None] Lock "cinder-58bce8a3-9434-4db8-a0e4-1ce4c690c3aa-delete_volume" released by "delete_volume" :: held 0.324s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:11:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:11:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:11:53 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=24,cinder:UPDATE=41,cinder:DELETE=4,cinder:INSERT=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:11:53 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=26,cinder:UPDATE=39,cinder:DELETE=4,cinder:INSERT=12 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:11:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:12:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Acquiring lock "cinder-07271548-fdf0-4933-9ca6-f2794b24e00d-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Lock "cinder-07271548-fdf0-4933-9ca6-f2794b24e00d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:12:11 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Acquiring lock "cinder-quobyte-07271548-fdf0-4933-9ca6-f2794b24e00d" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Lock "cinder-quobyte-07271548-fdf0-4933-9ca6-f2794b24e00d" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[189445c6-e481-48f6-be55-7584f4261642]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d" returned: 0 in 0.133s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-07271548-fdf0-4933-9ca6-f2794b24e00d" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Lock "cinder-quobyte-07271548-fdf0-4933-9ca6-f2794b24e00d" released by "delete_volume" :: held 0.184s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Created reservations ['f7e7b6e7-cca2-4dbb-b74a-e560178eaba3', 'b111da70-cd7b-4cab-9da6-6bfb4a73484b', 'c7d67c04-9aa5-43d8-a2d8-cc45db75206a', '4dfdafa8-7949-40cf-96cb-72d3358cf9c3'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:12:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:12:11 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Deleted volume successfully.
Sep 30 20:12:11 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e6bc0ac1-9686-438d-9b44-ceee8e646352 tempest-TaggedAttachmentsTest-827156841 None] Lock "cinder-07271548-fdf0-4933-9ca6-f2794b24e00d-delete_volume" released by "delete_volume" :: held 0.345s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:12:18 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Flow 'volume_create_manager' (6fae9085-979d-4534-a1bf-a56f256ef74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a9afd5-0071-43c7-bd30-e28afbd1913f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a9afd5-0071-43c7-bd30-e28afbd1913f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1490566428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f723b4da-8931-441b-9ae9-f7a3728dde57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f29073488047ae95f1d04cecc4cc32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:12:18Z,use_quota=True,user_id='7ac17936805b4e75a6a99a9e2b966985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc68536-1454-4723-a299-680e5ecdbf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc68536-1454-4723-a299-680e5ecdbf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fb73b0-879a-4b0d-b0be-ba2996acc40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fb73b0-879a-4b0d-b0be-ba2996acc40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f723b4da-8931-441b-9ae9-f7a3728dde57', 'volume_name': 'volume-f723b4da-8931-441b-9ae9-f7a3728dde57', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c84d4-16d5-4b44-9aaf-a568ed540f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c84d4-16d5-4b44-9aaf-a568ed540f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77a3553-1352-427a-a167-81f13b6cd4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:12:18 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Volume f723b4da-8931-441b-9ae9-f7a3728dde57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f723b4da-8931-441b-9ae9-f7a3728dde57', 'volume_size': 1}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1490566428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f723b4da-8931-441b-9ae9-f7a3728dde57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f29073488047ae95f1d04cecc4cc32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:12:18Z,use_quota=True,user_id='7ac17936805b4e75a6a99a9e2b966985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Creating volume f723b4da-8931-441b-9ae9-f7a3728dde57 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:12:18 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:12:18 devstack quobyte-client[79699]: System call "getlk" of process 88019 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:12:18 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=95, name=volume-f723b4da-8931-441b-9ae9-f7a3728dde57, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57 1073741824" returned: 0 in 0.125s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57" returned: 0 in 0.035s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] <== create_volume: return (176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.178s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77a3553-1352-427a-a167-81f13b6cd4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f723b4da-8931-441b-9ae9-f7a3728dde57', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a85714-f40d-49d7-b8db-1a9e1b70d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:12:18 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Volume volume-f723b4da-8931-441b-9ae9-f7a3728dde57 (f723b4da-8931-441b-9ae9-f7a3728dde57): created successfully
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a85714-f40d-49d7-b8db-1a9e1b70d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:12:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Flow 'volume_create_manager' (6fae9085-979d-4534-a1bf-a56f256ef74f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:12:18 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0263190c-0447-4f2a-9f5f-ed652709f3d4 tempest-TestMinimumBasicScenario-934626053 None] Created volume successfully.
Sep 30 20:12:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:12:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-0a35d103-dee3-427b-a1c7-f2aee8acfd4b req-258cc95e-a5e6-4710-bd75-d835cbd5d9a2 tempest-TestMinimumBasicScenario-934626053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:12:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-0a35d103-dee3-427b-a1c7-f2aee8acfd4b req-258cc95e-a5e6-4710-bd75-d835cbd5d9a2 tempest-TestMinimumBasicScenario-934626053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:12:22 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d54eb1-71ad-46ef-baaa-625ffbf52503]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:12:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-0a35d103-dee3-427b-a1c7-f2aee8acfd4b req-258cc95e-a5e6-4710-bd75-d835cbd5d9a2 tempest-TestMinimumBasicScenario-934626053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:12:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-0a35d103-dee3-427b-a1c7-f2aee8acfd4b req-258cc95e-a5e6-4710-bd75-d835cbd5d9a2 tempest-TestMinimumBasicScenario-934626053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57" returned: 0 in 0.179s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:12:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-0a35d103-dee3-427b-a1c7-f2aee8acfd4b req-258cc95e-a5e6-4710-bd75-d835cbd5d9a2 tempest-TestMinimumBasicScenario-934626053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.190s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:12:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-0a35d103-dee3-427b-a1c7-f2aee8acfd4b req-258cc95e-a5e6-4710-bd75-d835cbd5d9a2 tempest-TestMinimumBasicScenario-934626053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-f723b4da-8931-441b-9ae9-f7a3728dde57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6553e64c-bb1e-4868-9eb2-caf83fbd64be', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:12:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-0a35d103-dee3-427b-a1c7-f2aee8acfd4b req-258cc95e-a5e6-4710-bd75-d835cbd5d9a2 tempest-TestMinimumBasicScenario-934626053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:12:22 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-0a35d103-dee3-427b-a1c7-f2aee8acfd4b req-258cc95e-a5e6-4710-bd75-d835cbd5d9a2 tempest-TestMinimumBasicScenario-934626053 None] attachment_update completed successfully.
Sep 30 20:12:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:12:32 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=14,cinder:SELECT=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:12:32 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:12:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:12:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:12:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:12:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:12:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:13:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Flow 'volume_create_manager' (9f3f240e-511c-4f39-a839-fee701394f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0904ae2b-cfab-4fae-83f4-759c8377d92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0904ae2b-cfab-4fae-83f4-759c8377d92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1589557706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f829dff-220f-4754-aa66-5935390e2ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8d41e169d14d9e8a9b844677f74f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:13:47Z,use_quota=True,user_id='6835411274824651b02679f337d14358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c61ec79-9023-448a-aa78-0871db5f752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c61ec79-9023-448a-aa78-0871db5f752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8408022-db1d-43af-a445-6c7bcf4d03f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8408022-db1d-43af-a445-6c7bcf4d03f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f829dff-220f-4754-aa66-5935390e2ec6', 'volume_name': 'volume-9f829dff-220f-4754-aa66-5935390e2ec6', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3323e58b-6d3f-4d58-a2b0-d4a2cb84eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3323e58b-6d3f-4d58-a2b0-d4a2cb84eeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8ef507-83d6-4afd-8531-4e0c34cd0e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:13:47 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume 9f829dff-220f-4754-aa66-5935390e2ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f829dff-220f-4754-aa66-5935390e2ec6', 'volume_size': 1}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1589557706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f829dff-220f-4754-aa66-5935390e2ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8d41e169d14d9e8a9b844677f74f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:13:47Z,use_quota=True,user_id='6835411274824651b02679f337d14358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Creating volume 9f829dff-220f-4754-aa66-5935390e2ec6 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:13:47 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:13:47 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=96, name=volume-9f829dff-220f-4754-aa66-5935390e2ec6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6 1073741824" returned: 0 in 0.110s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] <== create_volume: return (139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.141s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8ef507-83d6-4afd-8531-4e0c34cd0e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f829dff-220f-4754-aa66-5935390e2ec6', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf26ba96-2c02-4380-a340-4e82e4b3e1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:13:47 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume volume-9f829dff-220f-4754-aa66-5935390e2ec6 (9f829dff-220f-4754-aa66-5935390e2ec6): created successfully
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf26ba96-2c02-4380-a340-4e82e4b3e1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:13:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Flow 'volume_create_manager' (9f3f240e-511c-4f39-a839-fee701394f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:13:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e28395c0-3686-4cc9-8cec-f3c21f82a027 tempest-AttachVolumeShelveTestJSON-393526056 None] Created volume successfully.
Sep 30 20:13:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:13:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:13:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:13:57 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:13:57 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:14:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-3b0c4b0b-c765-4185-bb5d-89c0d4153e09 req-c2923b98-5a89-4e84-9c5b-4b745cfa3e2c tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:14:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-3b0c4b0b-c765-4185-bb5d-89c0d4153e09 req-c2923b98-5a89-4e84-9c5b-4b745cfa3e2c tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:14:03 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94582c1-0be5-4725-993e-767de9d7be20]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:14:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-3b0c4b0b-c765-4185-bb5d-89c0d4153e09 req-c2923b98-5a89-4e84-9c5b-4b745cfa3e2c tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:14:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-3b0c4b0b-c765-4185-bb5d-89c0d4153e09 req-c2923b98-5a89-4e84-9c5b-4b745cfa3e2c tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6" returned: 0 in 0.132s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:14:03 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-3b0c4b0b-c765-4185-bb5d-89c0d4153e09 req-c2923b98-5a89-4e84-9c5b-4b745cfa3e2c tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.141s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:14:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-3b0c4b0b-c765-4185-bb5d-89c0d4153e09 req-c2923b98-5a89-4e84-9c5b-4b745cfa3e2c tempest-AttachVolumeShelveTestJSON-393526056 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-9f829dff-220f-4754-aa66-5935390e2ec6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b831feec-51c8-4fc2-ac60-e98f0a300e07', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:14:03 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-3b0c4b0b-c765-4185-bb5d-89c0d4153e09 req-c2923b98-5a89-4e84-9c5b-4b745cfa3e2c tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:14:03 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-3b0c4b0b-c765-4185-bb5d-89c0d4153e09 req-c2923b98-5a89-4e84-9c5b-4b745cfa3e2c tempest-AttachVolumeShelveTestJSON-393526056 None] attachment_update completed successfully.
Sep 30 20:14:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:14:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:14:13 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:14:13 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:14:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:14:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:14:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:14:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:14:45 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-2cf20932-df60-4f46-b38c-c3d276bafa31 req-fea76559-c060-44ce-8a22-df6114d79ef4 tempest-TestMinimumBasicScenario-934626053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:14:45 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-2cf20932-df60-4f46-b38c-c3d276bafa31 req-fea76559-c060-44ce-8a22-df6114d79ef4 tempest-TestMinimumBasicScenario-934626053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:14:45 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-2cf20932-df60-4f46-b38c-c3d276bafa31 req-fea76559-c060-44ce-8a22-df6114d79ef4 tempest-TestMinimumBasicScenario-934626053 None] Terminate volume connection completed successfully.
Sep 30 20:14:45 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-2cf20932-df60-4f46-b38c-c3d276bafa31 req-fea76559-c060-44ce-8a22-df6114d79ef4 tempest-TestMinimumBasicScenario-934626053 None] Deleting attachment 6553e64c-bb1e-4868-9eb2-caf83fbd64be. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Acquiring lock "cinder-f723b4da-8931-441b-9ae9-f7a3728dde57-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Lock "cinder-f723b4da-8931-441b-9ae9-f7a3728dde57-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:14:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Acquiring lock "cinder-quobyte-f723b4da-8931-441b-9ae9-f7a3728dde57" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Lock "cinder-quobyte-f723b4da-8931-441b-9ae9-f7a3728dde57" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b58fad-9090-4cf6-a551-0a021b279362]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57" returned: 0 in 0.141s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f723b4da-8931-441b-9ae9-f7a3728dde57" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Lock "cinder-quobyte-f723b4da-8931-441b-9ae9-f7a3728dde57" released by "delete_volume" :: held 0.188s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Created reservations ['87f2a5fa-0be7-4f00-8872-be20b77eb2e4', 'd314fffb-8583-40d4-b130-91c220e0d1a3', '5fee8780-70f9-4493-b0db-e58817d2c477', 'bbe161bb-b1b2-4422-a549-85bbb39fd891'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:14:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Deleted volume successfully.
Sep 30 20:14:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c95f90b5-f572-4bc8-85d0-141c89ae62de tempest-TestMinimumBasicScenario-934626053 None] Lock "cinder-f723b4da-8931-441b-9ae9-f7a3728dde57-delete_volume" released by "delete_volume" :: held 0.323s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:14:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:14:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:14:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:15:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:15:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:15:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=6,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:15:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:15:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:15:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:15:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:15:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:15:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-2b7deb08-83da-41a4-8793-59dec7167a01 req-55c1804e-029f-448b-8ea9-410ffb757c95 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:15:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-2b7deb08-83da-41a4-8793-59dec7167a01 req-55c1804e-029f-448b-8ea9-410ffb757c95 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:15:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-2b7deb08-83da-41a4-8793-59dec7167a01 req-55c1804e-029f-448b-8ea9-410ffb757c95 tempest-AttachVolumeShelveTestJSON-393526056 None] Terminate volume connection completed successfully.
Sep 30 20:15:46 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-2b7deb08-83da-41a4-8793-59dec7167a01 req-55c1804e-029f-448b-8ea9-410ffb757c95 tempest-AttachVolumeShelveTestJSON-393526056 None] Deleting attachment b831feec-51c8-4fc2-ac60-e98f0a300e07. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:15:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:15:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:15:56 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=2 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:15:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:16:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:16:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:16:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:16:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:16:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:16:35 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Flow 'volume_create_manager' (b0ba0526-fcf6-4c98-9b3f-9bfc63af4f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fca8e4e-414f-409a-b925-74eff7792adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fca8e4e-414f-409a-b925-74eff7792adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-687290504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e9f142-5e94-4d8d-9f29-2e46d4fbe480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42a382a76c24f999ab2742e37120f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:16:35Z,use_quota=True,user_id='b201403eed9046b69adc9e7f64e73389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ca2202-88cf-45fa-b1df-a8a4585cc3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ca2202-88cf-45fa-b1df-a8a4585cc3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da1b3f1-ad14-4b6b-8882-e0f1d883dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da1b3f1-ad14-4b6b-8882-e0f1d883dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e9f142-5e94-4d8d-9f29-2e46d4fbe480', 'volume_name': 'volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ce4be9-a713-4ef5-ae76-6016b08e5a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ce4be9-a713-4ef5-ae76-6016b08e5a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504b1a88-e690-4386-9305-b333ba82f228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:16:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Volume d7e9f142-5e94-4d8d-9f29-2e46d4fbe480: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480', 'volume_size': 1}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-687290504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e9f142-5e94-4d8d-9f29-2e46d4fbe480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42a382a76c24f999ab2742e37120f2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:16:35Z,use_quota=True,user_id='b201403eed9046b69adc9e7f64e73389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Creating volume d7e9f142-5e94-4d8d-9f29-2e46d4fbe480 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:16:35 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:16:35 devstack quobyte-client[79699]: System call "ioctl" of process 89545 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:16:35 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=97, name=volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480 1073741824" returned: 0 in 0.142s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] <== create_volume: return (169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.172s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (504b1a88-e690-4386-9305-b333ba82f228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3e7f6d-349d-4d07-847d-5072031446d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:16:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Volume volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480 (d7e9f142-5e94-4d8d-9f29-2e46d4fbe480): created successfully
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3e7f6d-349d-4d07-847d-5072031446d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:16:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Flow 'volume_create_manager' (b0ba0526-fcf6-4c98-9b3f-9bfc63af4f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:16:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-112ac255-9ff9-4825-9107-3f62128fbc0e tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Created volume successfully.
Sep 30 20:16:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-f0cd1ac3-4917-4f4e-b20d-8f091444ec0a req-ea8d37ad-ddce-4e1c-88c6-d12c68711839 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:16:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-f0cd1ac3-4917-4f4e-b20d-8f091444ec0a req-ea8d37ad-ddce-4e1c-88c6-d12c68711839 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:16:39 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b16cc8-170d-4c87-a504-4b3c72210fd0]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:16:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-f0cd1ac3-4917-4f4e-b20d-8f091444ec0a req-ea8d37ad-ddce-4e1c-88c6-d12c68711839 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:16:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-f0cd1ac3-4917-4f4e-b20d-8f091444ec0a req-ea8d37ad-ddce-4e1c-88c6-d12c68711839 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480" returned: 0 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:16:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-f0cd1ac3-4917-4f4e-b20d-8f091444ec0a req-ea8d37ad-ddce-4e1c-88c6-d12c68711839 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.154s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:16:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-f0cd1ac3-4917-4f4e-b20d-8f091444ec0a req-ea8d37ad-ddce-4e1c-88c6-d12c68711839 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a463e520-3db2-4efd-b6ba-7d6dcef4cbec', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:16:39 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-f0cd1ac3-4917-4f4e-b20d-8f091444ec0a req-ea8d37ad-ddce-4e1c-88c6-d12c68711839 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:16:39 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-f0cd1ac3-4917-4f4e-b20d-8f091444ec0a req-ea8d37ad-ddce-4e1c-88c6-d12c68711839 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] attachment_update completed successfully.
Sep 30 20:16:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:16:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:16:49 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:16:49 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=6,cinder:DELETE=1,cinder:SELECT=5 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:16:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:16:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:17:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:17:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:17:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:17:06 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-cba9e36a-806f-41a5-9fa2-bff10a5523c2 req-76d609c6-b324-4f03-81ab-b383e0b5a6c9 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:06 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-cba9e36a-806f-41a5-9fa2-bff10a5523c2 req-76d609c6-b324-4f03-81ab-b383e0b5a6c9 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-cba9e36a-806f-41a5-9fa2-bff10a5523c2 req-76d609c6-b324-4f03-81ab-b383e0b5a6c9 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Terminate volume connection completed successfully.
Sep 30 20:17:06 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-cba9e36a-806f-41a5-9fa2-bff10a5523c2 req-76d609c6-b324-4f03-81ab-b383e0b5a6c9 tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Deleting attachment a463e520-3db2-4efd-b6ba-7d6dcef4cbec. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Acquiring lock "cinder-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "cinder-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:08 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Acquiring lock "cinder-quobyte-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "cinder-quobyte-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d7acf4-731a-4230-bf57-a94d7b4827a2]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480" returned: 0 in 0.155s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "cinder-quobyte-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480" released by "delete_volume" :: held 0.195s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Created reservations ['1bb4b8bb-0367-4549-a16a-9ba815cbcac3', 'de90aef9-6c1b-464d-9527-fff072fc1966', 'e24a3952-a29a-447e-8c67-7e7e5223412e', '629f1ec5-305c-4d36-9631-8aa184815537'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:17:09 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Deleted volume successfully.
Sep 30 20:17:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6603cec7-0b77-45df-ab11-273a550dc40a tempest-TestServerVolumeAttachScenarioOldVersion-1101460266 None] Lock "cinder-d7e9f142-5e94-4d8d-9f29-2e46d4fbe480-delete_volume" released by "delete_volume" :: held 0.327s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:17:15 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Flow 'volume_create_manager' (9656c31c-cc0a-44f2-87b3-8d2a198d31ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352c1c05-de8b-47dc-b4d0-0c7f186556fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352c1c05-de8b-47dc-b4d0-0c7f186556fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-985032249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f397552d-d4cb-4ccb-b643-db87cb7078b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8d41e169d14d9e8a9b844677f74f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:16Z,use_quota=True,user_id='6835411274824651b02679f337d14358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a8ae08-519f-4155-a0ff-6af71f3dc60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a8ae08-519f-4155-a0ff-6af71f3dc60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c3a5ca-9ee4-4f28-92e0-6355229e91e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c3a5ca-9ee4-4f28-92e0-6355229e91e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f397552d-d4cb-4ccb-b643-db87cb7078b2', 'volume_name': 'volume-f397552d-d4cb-4ccb-b643-db87cb7078b2', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0e7991-9da8-415f-9197-112872b3718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0e7991-9da8-415f-9197-112872b3718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25578915-6db2-4745-9853-192391123b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:15 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume f397552d-d4cb-4ccb-b643-db87cb7078b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f397552d-d4cb-4ccb-b643-db87cb7078b2', 'volume_size': 1}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-985032249',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f397552d-d4cb-4ccb-b643-db87cb7078b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b8d41e169d14d9e8a9b844677f74f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:16Z,use_quota=True,user_id='6835411274824651b02679f337d14358',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Creating volume f397552d-d4cb-4ccb-b643-db87cb7078b2 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:17:15 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f397552d-d4cb-4ccb-b643-db87cb7078b2 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:15 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=98, name=volume-f397552d-d4cb-4ccb-b643-db87cb7078b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f397552d-d4cb-4ccb-b643-db87cb7078b2 1073741824" returned: 0 in 0.136s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f397552d-d4cb-4ccb-b643-db87cb7078b2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f397552d-d4cb-4ccb-b643-db87cb7078b2" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] <== create_volume: return (162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.165s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25578915-6db2-4745-9853-192391123b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f397552d-d4cb-4ccb-b643-db87cb7078b2', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d779a02d-fdfc-4bae-a4d0-5dcc761cb6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:15 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume volume-f397552d-d4cb-4ccb-b643-db87cb7078b2 (f397552d-d4cb-4ccb-b643-db87cb7078b2): created successfully
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d779a02d-fdfc-4bae-a4d0-5dcc761cb6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:15 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Flow 'volume_create_manager' (9656c31c-cc0a-44f2-87b3-8d2a198d31ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:15 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-05a2a15c-e7a7-4216-b894-e53db78b0d95 tempest-AttachVolumeShelveTestJSON-393526056 None] Created volume successfully.
Sep 30 20:17:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:17:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (217ddc3f-c9ab-4bbe-bce0-3d2cd5e60b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294ce8a1-1182-4aca-9e84-770cc3b99b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294ce8a1-1182-4aca-9e84-770cc3b99b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1400543107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21641535-082d-4a46-866a-2c262dad0adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:25Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10af4f9-75e2-4ee2-a0b5-b3afed702929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10af4f9-75e2-4ee2-a0b5-b3afed702929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15c8531-eb15-4838-a3ff-e186814fcdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15c8531-eb15-4838-a3ff-e186814fcdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21641535-082d-4a46-866a-2c262dad0adf', 'volume_name': 'volume-21641535-082d-4a46-866a-2c262dad0adf', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054cf396-f4d6-4d7c-a894-33f76eb8fa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054cf396-f4d6-4d7c-a894-33f76eb8fa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a796412a-6557-4852-b7ae-cf67b29ad264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:24 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Volume 21641535-082d-4a46-866a-2c262dad0adf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21641535-082d-4a46-866a-2c262dad0adf', 'volume_size': 1}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1400543107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21641535-082d-4a46-866a-2c262dad0adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:25Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Creating volume 21641535-082d-4a46-866a-2c262dad0adf {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:17:24 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:17:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-21641535-082d-4a46-866a-2c262dad0adf 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:24 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=99, name=volume-21641535-082d-4a46-866a-2c262dad0adf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:17:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (b6824b63-2739-42f5-a174-36fccf691b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f036b3f1-e8f2-4b45-a968-12625e58880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-21641535-082d-4a46-866a-2c262dad0adf 1073741824" returned: 0 in 0.147s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-21641535-082d-4a46-866a-2c262dad0adf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f036b3f1-e8f2-4b45-a968-12625e58880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412226616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e7992c-e323-4ffb-bcfc-e51f55e4fd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:25Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06932a23-7138-4391-87ae-e397af725fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06932a23-7138-4391-87ae-e397af725fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25f1b7a-c75d-4331-b52b-4d593956172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25f1b7a-c75d-4331-b52b-4d593956172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e7992c-e323-4ffb-bcfc-e51f55e4fd63', 'volume_name': 'volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3c938e-5c10-44fe-9e2d-4f3304648516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3c938e-5c10-44fe-9e2d-4f3304648516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ddcf9d-e1fe-4103-abff-7a741d31f302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Volume 72e7992c-e323-4ffb-bcfc-e51f55e4fd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63', 'volume_size': 1}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-21641535-082d-4a46-866a-2c262dad0adf" returned: 0 in 0.049s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] <== create_volume: return (203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.205s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412226616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e7992c-e323-4ffb-bcfc-e51f55e4fd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:25Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Creating volume 72e7992c-e323-4ffb-bcfc-e51f55e4fd63 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a796412a-6557-4852-b7ae-cf67b29ad264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21641535-082d-4a46-866a-2c262dad0adf', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bbe35b9-6051-4660-b018-4db9fe53f2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack quobyte-client[79699]: System call "getattr" of process 90288 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Volume volume-21641535-082d-4a46-866a-2c262dad0adf (21641535-082d-4a46-866a-2c262dad0adf): created successfully
Sep 30 20:17:25 devstack quobyte-client[79699]: System call "lookup" of process 90288 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bbe35b9-6051-4660-b018-4db9fe53f2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack quobyte-client[79699]: System call "create" of process 90288 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:17:25 devstack quobyte-client[79699]: System call "getattr" of process 90288 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (217ddc3f-c9ab-4bbe-bce0-3d2cd5e60b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-218fc1b7-4af6-42a9-ad7d-80e4fc1bc19f tempest-CreateVolumesFromImageTest-1534534043 None] Created volume successfully.
Sep 30 20:17:25 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=100, name=volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:17:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (606abc26-5743-4ea4-890e-168d8f1f083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf231d4-a40c-4b80-8aaa-e61635e461f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63 1073741824" returned: 0 in 0.170s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf231d4-a40c-4b80-8aaa-e61635e461f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034531810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bb23fb-7415-4ad6-952e-e35f379decec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:25Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8d684b-3a4f-4fbe-9c44-b61ff3e56957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8d684b-3a4f-4fbe-9c44-b61ff3e56957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a59f8f6-dee6-4a9d-b425-089077c817ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a59f8f6-dee6-4a9d-b425-089077c817ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bb23fb-7415-4ad6-952e-e35f379decec', 'volume_name': 'volume-94bb23fb-7415-4ad6-952e-e35f379decec', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9d856a-44a2-415e-a514-2146e750d8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f9d856a-44a2-415e-a514-2146e750d8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211db758-f58e-415a-a5f5-440b86db1907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Volume 94bb23fb-7415-4ad6-952e-e35f379decec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bb23fb-7415-4ad6-952e-e35f379decec', 'volume_size': 1}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63" returned: 0 in 0.068s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] <== create_volume: return (245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.247s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034531810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bb23fb-7415-4ad6-952e-e35f379decec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:25Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Creating volume 94bb23fb-7415-4ad6-952e-e35f379decec {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-94bb23fb-7415-4ad6-952e-e35f379decec 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ddcf9d-e1fe-4103-abff-7a741d31f302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52588e85-2d73-4bdb-a059-509e6bc1e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Volume volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63 (72e7992c-e323-4ffb-bcfc-e51f55e4fd63): created successfully
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52588e85-2d73-4bdb-a059-509e6bc1e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (b6824b63-2739-42f5-a174-36fccf691b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-cfc33186-4a2e-4708-9599-97c26cb6000f tempest-CreateVolumesFromImageTest-1534534043 None] Created volume successfully.
Sep 30 20:17:25 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=101, name=volume-94bb23fb-7415-4ad6-952e-e35f379decec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:17:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (047aa5c5-78fe-443d-af42-6fa2e639663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89d806f-2111-40be-8e20-9411bb8a72f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-94bb23fb-7415-4ad6-952e-e35f379decec 1073741824" returned: 0 in 0.169s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-94bb23fb-7415-4ad6-952e-e35f379decec {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d89d806f-2111-40be-8e20-9411bb8a72f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747223175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c82528-4c37-4c1b-9647-21eda7b4f5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:25Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbf6a57-ebfb-4d8b-9bf3-8bc99b88b096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbf6a57-ebfb-4d8b-9bf3-8bc99b88b096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb17588-7740-434b-9387-17887a90c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb17588-7740-434b-9387-17887a90c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c82528-4c37-4c1b-9647-21eda7b4f5e7', 'volume_name': 'volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12f0ee1-3c93-45b1-bbaa-18feb9b34d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12f0ee1-3c93-45b1-bbaa-18feb9b34d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1798a9e-de77-4e26-a8c5-5c479009de28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Volume 67c82528-4c37-4c1b-9647-21eda7b4f5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7', 'volume_size': 1}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-94bb23fb-7415-4ad6-952e-e35f379decec" returned: 0 in 0.053s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] <== create_volume: return (228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.230s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747223175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c82528-4c37-4c1b-9647-21eda7b4f5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:25Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Creating volume 67c82528-4c37-4c1b-9647-21eda7b4f5e7 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211db758-f58e-415a-a5f5-440b86db1907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bb23fb-7415-4ad6-952e-e35f379decec', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33efd284-4784-4ddb-bf89-4ecb468a173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack quobyte-client[79699]: System call "ioctl" of process 90296 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:17:25 devstack quobyte-client[79699]: System call "open" of process 90296 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:17:25 devstack quobyte-client[79699]: System call "ioctl" of process 90296 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:17:25 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=102, name=volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Volume volume-94bb23fb-7415-4ad6-952e-e35f379decec (94bb23fb-7415-4ad6-952e-e35f379decec): created successfully
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33efd284-4784-4ddb-bf89-4ecb468a173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (606abc26-5743-4ea4-890e-168d8f1f083a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-408e8ee6-ddd7-4bdb-9682-efaf5424fe29 tempest-CreateVolumesFromImageTest-1534534043 None] Created volume successfully.
Sep 30 20:17:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (41797dbd-67de-409f-8e32-0659f70ea287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0aeeed-305b-4ba5-b218-6cf634350d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0aeeed-305b-4ba5-b218-6cf634350d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101448882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b42e54-7fee-4173-b9d3-cb4b1f63c917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:26Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0d531d-bc58-49aa-8700-35c9179fdb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0d531d-bc58-49aa-8700-35c9179fdb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a8eab6-7e2c-4342-ac62-d0bc78c70001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a8eab6-7e2c-4342-ac62-d0bc78c70001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b42e54-7fee-4173-b9d3-cb4b1f63c917', 'volume_name': 'volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4f4c7e-d173-47e6-9365-b9e55bd4483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4f4c7e-d173-47e6-9365-b9e55bd4483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c3e1b2-5e64-4944-b658-f07952085ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Volume c9b42e54-7fee-4173-b9d3-cb4b1f63c917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917', 'volume_size': 1}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7 1073741824" returned: 0 in 0.178s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] <== create_volume: return (207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.210s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-101448882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b42e54-7fee-4173-b9d3-cb4b1f63c917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440aca087a6c4ab1b49becbba952d4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:17:26Z,use_quota=True,user_id='3bf75e706d2b491786230c35de23e027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Creating volume c9b42e54-7fee-4173-b9d3-cb4b1f63c917 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1798a9e-de77-4e26-a8c5-5c479009de28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c702175f-1e4c-4673-a4ac-93829614ccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Volume volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7 (67c82528-4c37-4c1b-9647-21eda7b4f5e7): created successfully
Sep 30 20:17:25 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=103, name=volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c702175f-1e4c-4673-a4ac-93829614ccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (047aa5c5-78fe-443d-af42-6fa2e639663d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1dd16320-6843-4db6-b8ad-ce72c10e1c1f tempest-CreateVolumesFromImageTest-1534534043 None] Created volume successfully.
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917 1073741824" returned: 0 in 0.109s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] <== create_volume: return (133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.137s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c3e1b2-5e64-4944-b658-f07952085ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:25 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe072d7f-dc79-42f7-8b22-e722f27cb811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:17:25 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Volume volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917 (c9b42e54-7fee-4173-b9d3-cb4b1f63c917): created successfully
Sep 30 20:17:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe072d7f-dc79-42f7-8b22-e722f27cb811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:17:26 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Flow 'volume_create_manager' (41797dbd-67de-409f-8e32-0659f70ea287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:17:26 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1dba1559-a319-438d-bbee-7d8a794e7118 tempest-CreateVolumesFromImageTest-1534534043 None] Created volume successfully.
Sep 30 20:17:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:17:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-c9b42e54-7fee-4173-b9d3-cb4b1f63c917-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-c9b42e54-7fee-4173-b9d3-cb4b1f63c917-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:27 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-quobyte-c9b42e54-7fee-4173-b9d3-cb4b1f63c917" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-c9b42e54-7fee-4173-b9d3-cb4b1f63c917" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[52466a37-b28f-487c-9a3f-d6eec39783b1]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917" returned: 0 in 0.149s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c9b42e54-7fee-4173-b9d3-cb4b1f63c917" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-c9b42e54-7fee-4173-b9d3-cb4b1f63c917" released by "delete_volume" :: held 0.202s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Created reservations ['21214c2e-db87-474c-b19e-97fa43cf677e', '871365a7-2754-4d88-a3d7-402517159c1f', 'a2675a23-968a-49e9-b660-f16404748c56', '6c0e66fc-2491-4639-a378-c504f7a24aec'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:17:27 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Deleted volume successfully.
Sep 30 20:17:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6dd26d5b-75c7-46ba-9e55-e90c505a26c5 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-c9b42e54-7fee-4173-b9d3-cb4b1f63c917-delete_volume" released by "delete_volume" :: held 0.350s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-67c82528-4c37-4c1b-9647-21eda7b4f5e7-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-67c82528-4c37-4c1b-9647-21eda7b4f5e7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-quobyte-67c82528-4c37-4c1b-9647-21eda7b4f5e7" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-67c82528-4c37-4c1b-9647-21eda7b4f5e7" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3709d788-1e63-4ad1-bf82-272f72070d30]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7" returned: 0 in 0.145s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-67c82528-4c37-4c1b-9647-21eda7b4f5e7" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-67c82528-4c37-4c1b-9647-21eda7b4f5e7" released by "delete_volume" :: held 0.200s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Created reservations ['3a19d345-3fc4-4b12-b371-384d01e426d1', '5f6996ff-9892-4406-ade7-29530e068b6d', '699989b5-5e76-4258-8f68-1fdbe3ec627c', '53e063b5-b911-4827-8cf2-4963ca0d0101'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:17:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Deleted volume successfully.
Sep 30 20:17:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d640b4eb-3ab2-4f36-a8c4-b197afd94dbd tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-67c82528-4c37-4c1b-9647-21eda7b4f5e7-delete_volume" released by "delete_volume" :: held 0.343s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-94bb23fb-7415-4ad6-952e-e35f379decec-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-94bb23fb-7415-4ad6-952e-e35f379decec-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-quobyte-94bb23fb-7415-4ad6-952e-e35f379decec" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-94bb23fb-7415-4ad6-952e-e35f379decec" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcedc06-2b36-412f-94d8-b3b7546cc469]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-94bb23fb-7415-4ad6-952e-e35f379decec {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-94bb23fb-7415-4ad6-952e-e35f379decec" returned: 0 in 0.155s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-94bb23fb-7415-4ad6-952e-e35f379decec {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-94bb23fb-7415-4ad6-952e-e35f379decec" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-94bb23fb-7415-4ad6-952e-e35f379decec" released by "delete_volume" :: held 0.204s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Created reservations ['51f5022a-8775-49b9-973a-4a051f12e9d8', '18ba0b78-d98e-4f49-aa91-3dc55f844674', '73886214-a435-4ff4-81d8-9b93017e8a71', '75ca8964-38e8-4b1e-b125-cefd9ffa6c69'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:17:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Deleted volume successfully.
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b6ad083-43ea-4f8b-905a-4547e7b59722 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-94bb23fb-7415-4ad6-952e-e35f379decec-delete_volume" released by "delete_volume" :: held 0.353s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-3d7feeea-4b1d-4fde-804e-4be70637d9a6 req-64084f2b-a120-4610-9cc6-e7f5bbfcade4 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-3d7feeea-4b1d-4fde-804e-4be70637d9a6 req-64084f2b-a120-4610-9cc6-e7f5bbfcade4 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-3d7feeea-4b1d-4fde-804e-4be70637d9a6 req-64084f2b-a120-4610-9cc6-e7f5bbfcade4 tempest-AttachVolumeShelveTestJSON-393526056 None] No connector for attachment 78c6ed22-c3c0-4873-a9af-35053d2d5002; skipping storage backend terminate_connection call. {{(pid=79893) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 30 20:17:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-3d7feeea-4b1d-4fde-804e-4be70637d9a6 req-64084f2b-a120-4610-9cc6-e7f5bbfcade4 tempest-AttachVolumeShelveTestJSON-393526056 None] Deleting attachment 78c6ed22-c3c0-4873-a9af-35053d2d5002. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-72e7992c-e323-4ffb-bcfc-e51f55e4fd63-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-72e7992c-e323-4ffb-bcfc-e51f55e4fd63-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-quobyte-72e7992c-e323-4ffb-bcfc-e51f55e4fd63" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-72e7992c-e323-4ffb-bcfc-e51f55e4fd63" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[378f0719-a11f-4f19-be68-afc1b8cb38ed]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63" returned: 0 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-72e7992c-e323-4ffb-bcfc-e51f55e4fd63" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-72e7992c-e323-4ffb-bcfc-e51f55e4fd63" released by "delete_volume" :: held 0.204s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Created reservations ['09159258-7b35-4c45-8373-fb3758300e63', 'c5314aee-8e57-438b-8869-ac27f0f0b9bf', '72a4d9e5-5859-4671-849b-670a48257cb4', '8ee9a467-3411-40be-afb9-ac0310b41aee'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:17:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Deleted volume successfully.
Sep 30 20:17:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ab4bea66-ccdd-4764-8052-65fc31f22ab1 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-72e7992c-e323-4ffb-bcfc-e51f55e4fd63-delete_volume" released by "delete_volume" :: held 0.371s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-21641535-082d-4a46-866a-2c262dad0adf-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-21641535-082d-4a46-866a-2c262dad0adf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:31 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "cinder-quobyte-21641535-082d-4a46-866a-2c262dad0adf" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-21641535-082d-4a46-866a-2c262dad0adf" acquired by "delete_volume" :: waited 0.016s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2f2115-6547-40da-bb18-0efaa1171168]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-21641535-082d-4a46-866a-2c262dad0adf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-21641535-082d-4a46-866a-2c262dad0adf" returned: 0 in 0.152s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-21641535-082d-4a46-866a-2c262dad0adf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-21641535-082d-4a46-866a-2c262dad0adf" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-quobyte-21641535-082d-4a46-866a-2c262dad0adf" released by "delete_volume" :: held 0.196s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Created reservations ['678ec4b4-f82c-487d-82e0-bb96b724e2fd', '429b3abd-6974-4bbd-99c4-0f70702ca4ee', 'efa57902-ad2c-48f3-a691-496d3b8e6b81', '5646a5c4-e58f-44dd-8551-fba7cbdba910'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:17:31 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Deleted volume successfully.
Sep 30 20:17:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ea0debd6-b394-4884-87d9-f9f89a06ca52 tempest-CreateVolumesFromImageTest-1534534043 None] Lock "cinder-21641535-082d-4a46-866a-2c262dad0adf-delete_volume" released by "delete_volume" :: held 0.349s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:17:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:17:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:17:41 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=31,cinder:INSERT=14,cinder:UPDATE=63,cinder:DELETE=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:17:41 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=45,cinder:UPDATE=57,cinder:INSERT=10,cinder:DELETE=8 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:17:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:17:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:17:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.038s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:18:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:18:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:18:57 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "cinder-f397552d-d4cb-4ccb-b643-db87cb7078b2-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:18:57 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "cinder-f397552d-d4cb-4ccb-b643-db87cb7078b2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:18:57 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:18:57 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "cinder-quobyte-f397552d-d4cb-4ccb-b643-db87cb7078b2" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:18:57 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "cinder-quobyte-f397552d-d4cb-4ccb-b643-db87cb7078b2" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a5b0ab-a283-4469-a6a5-0638bd69edbd]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f397552d-d4cb-4ccb-b643-db87cb7078b2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f397552d-d4cb-4ccb-b643-db87cb7078b2" returned: 0 in 0.138s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f397552d-d4cb-4ccb-b643-db87cb7078b2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-f397552d-d4cb-4ccb-b643-db87cb7078b2" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "cinder-quobyte-f397552d-d4cb-4ccb-b643-db87cb7078b2" released by "delete_volume" :: held 0.182s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Created reservations ['4dfa96df-452c-4950-958a-c96880f3413f', '1cc7fac8-e779-4169-9eb4-1332908b4ece', '64d8dccf-9413-4867-8708-6d22ee7fcf45', 'd07572e6-157a-4ef9-9c2f-957b46cbff73'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:18:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Deleted volume successfully.
Sep 30 20:18:58 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-75fe28b4-6746-4cd2-a5b8-f87ec58df301 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "cinder-f397552d-d4cb-4ccb-b643-db87cb7078b2-delete_volume" released by "delete_volume" :: held 0.329s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "cinder-9f829dff-220f-4754-aa66-5935390e2ec6-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "cinder-9f829dff-220f-4754-aa66-5935390e2ec6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:18:59 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "cinder-quobyte-9f829dff-220f-4754-aa66-5935390e2ec6" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "cinder-quobyte-9f829dff-220f-4754-aa66-5935390e2ec6" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f14349-1a69-422f-bdf0-0551477239b3]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9f829dff-220f-4754-aa66-5935390e2ec6" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "cinder-quobyte-9f829dff-220f-4754-aa66-5935390e2ec6" released by "delete_volume" :: held 0.173s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Created reservations ['cba79920-7a40-4a61-9d38-2decc32ac7da', 'b4541f85-f0b6-459d-8fe3-f1e08a71921d', '36a8ea28-0d77-4047-83b2-9d473e735c9b', '7d1eb7f8-47cc-40c7-867c-1b90090ba548'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:18:59 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Deleted volume successfully.
Sep 30 20:18:59 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-089f1bac-92af-4927-b571-126bce018d86 tempest-AttachVolumeShelveTestJSON-393526056 None] Lock "cinder-9f829dff-220f-4754-aa66-5935390e2ec6-delete_volume" released by "delete_volume" :: held 0.306s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:19:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:19:09 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=15,cinder:SELECT=9,cinder:INSERT=5,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:19:09 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:19:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:19:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:19:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:19:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:19:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:19:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:19:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:19:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:20:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:20:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:20:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:20:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:20:31 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Flow 'volume_create_manager' (02366f3e-9f44-45f3-bb1d-fb6ceb7db44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb556aab-daa5-48f7-abcf-18fca4939653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb556aab-daa5-48f7-abcf-18fca4939653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-666936518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b9afbc-fc79-4340-8314-086fa5140c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62495123145431eae3b4d069dc6238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:20:31Z,use_quota=True,user_id='fd59ef80c1944c9baf9ce0461b65b738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaae3e4-db05-46e7-a9fa-f46a72a43963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdaae3e4-db05-46e7-a9fa-f46a72a43963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b9727f-c74b-4ccd-aa22-1b801240ce32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b9727f-c74b-4ccd-aa22-1b801240ce32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b9afbc-fc79-4340-8314-086fa5140c25', 'volume_name': 'volume-41b9afbc-fc79-4340-8314-086fa5140c25', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a693d6-ac1c-42b4-a764-499abca070a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a693d6-ac1c-42b4-a764-499abca070a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c54b12-c889-4fe2-a623-ba16b709f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:20:31 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Volume 41b9afbc-fc79-4340-8314-086fa5140c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b9afbc-fc79-4340-8314-086fa5140c25', 'volume_size': 1}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-666936518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b9afbc-fc79-4340-8314-086fa5140c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62495123145431eae3b4d069dc6238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:20:31Z,use_quota=True,user_id='fd59ef80c1944c9baf9ce0461b65b738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Creating volume 41b9afbc-fc79-4340-8314-086fa5140c25 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:20:31 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:20:31 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=104, name=volume-41b9afbc-fc79-4340-8314-086fa5140c25, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25 1073741824" returned: 0 in 0.107s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] <== create_volume: return (132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.134s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c54b12-c889-4fe2-a623-ba16b709f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b9afbc-fc79-4340-8314-086fa5140c25', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f536c8a-76e4-4179-812f-d6afc1f8d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:20:31 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Volume volume-41b9afbc-fc79-4340-8314-086fa5140c25 (41b9afbc-fc79-4340-8314-086fa5140c25): created successfully
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f536c8a-76e4-4179-812f-d6afc1f8d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:20:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Flow 'volume_create_manager' (02366f3e-9f44-45f3-bb1d-fb6ceb7db44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:20:31 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6e752157-5c25-4649-a0bd-08052db90640 tempest-AttachVolumeNegativeTest-2098133805 None] Created volume successfully.
Sep 30 20:20:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:20:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-12e7c8d3-f97d-4cd9-9fdf-d7db7f5efaa8 req-66567ff2-8360-46d5-8033-0782657b9487 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:20:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-12e7c8d3-f97d-4cd9-9fdf-d7db7f5efaa8 req-66567ff2-8360-46d5-8033-0782657b9487 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:20:35 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdbed1e-abee-4cf6-a9af-d1fc7330a2c4]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:20:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-12e7c8d3-f97d-4cd9-9fdf-d7db7f5efaa8 req-66567ff2-8360-46d5-8033-0782657b9487 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:20:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-12e7c8d3-f97d-4cd9-9fdf-d7db7f5efaa8 req-66567ff2-8360-46d5-8033-0782657b9487 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25" returned: 0 in 0.130s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:20:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-12e7c8d3-f97d-4cd9-9fdf-d7db7f5efaa8 req-66567ff2-8360-46d5-8033-0782657b9487 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.139s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:20:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-12e7c8d3-f97d-4cd9-9fdf-d7db7f5efaa8 req-66567ff2-8360-46d5-8033-0782657b9487 tempest-AttachVolumeNegativeTest-2098133805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-41b9afbc-fc79-4340-8314-086fa5140c25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '830d4ef0-c5d3-44f3-ac9f-9a8ea08a30e2', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:20:35 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-12e7c8d3-f97d-4cd9-9fdf-d7db7f5efaa8 req-66567ff2-8360-46d5-8033-0782657b9487 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:20:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-12e7c8d3-f97d-4cd9-9fdf-d7db7f5efaa8 req-66567ff2-8360-46d5-8033-0782657b9487 tempest-AttachVolumeNegativeTest-2098133805 None] attachment_update completed successfully.
Sep 30 20:20:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:20:45 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=6 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:20:45 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:20:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:20:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:20:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:21:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:21:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:21:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:21:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:21:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:21:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:21:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:21:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:21:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:21:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:21:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:22:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:22:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:22:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:22:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:22:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-9ee166d2-40ad-4495-b58f-b19372539f8f req-cb5e806e-cf39-4ee1-b11c-67a57b69fea8 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:22:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-9ee166d2-40ad-4495-b58f-b19372539f8f req-cb5e806e-cf39-4ee1-b11c-67a57b69fea8 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:22:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-9ee166d2-40ad-4495-b58f-b19372539f8f req-cb5e806e-cf39-4ee1-b11c-67a57b69fea8 tempest-AttachVolumeNegativeTest-2098133805 None] Terminate volume connection completed successfully.
Sep 30 20:22:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-9ee166d2-40ad-4495-b58f-b19372539f8f req-cb5e806e-cf39-4ee1-b11c-67a57b69fea8 tempest-AttachVolumeNegativeTest-2098133805 None] Deleting attachment 830d4ef0-c5d3-44f3-ac9f-9a8ea08a30e2. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:22:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:22:39 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=2 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:22:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:22:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:22:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:22:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:23:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:23:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:23:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:23:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:23:57 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:23:57 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Flow 'volume_create_manager' (314e7bb5-efda-451f-aad4-3dd627ee8114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cde15c4-c662-4a1b-b12c-c8339549376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cde15c4-c662-4a1b-b12c-c8339549376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-844836450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521b6b01-1124-44b3-a7e6-511f4c5db02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62495123145431eae3b4d069dc6238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:23:58Z,use_quota=True,user_id='fd59ef80c1944c9baf9ce0461b65b738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200517d0-c08a-4b32-8390-4392b78edf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200517d0-c08a-4b32-8390-4392b78edf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634f9ed9-3a1c-46d6-bac6-3d02dd44eef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634f9ed9-3a1c-46d6-bac6-3d02dd44eef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '521b6b01-1124-44b3-a7e6-511f4c5db02b', 'volume_name': 'volume-521b6b01-1124-44b3-a7e6-511f4c5db02b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf4d0d6-7971-4467-9fdb-61d4e9f2eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf4d0d6-7971-4467-9fdb-61d4e9f2eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b50ce1-6e52-4ea4-8dc9-036167e79a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:23:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Volume 521b6b01-1124-44b3-a7e6-511f4c5db02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-521b6b01-1124-44b3-a7e6-511f4c5db02b', 'volume_size': 1}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-844836450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=521b6b01-1124-44b3-a7e6-511f4c5db02b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62495123145431eae3b4d069dc6238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:23:58Z,use_quota=True,user_id='fd59ef80c1944c9baf9ce0461b65b738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Creating volume 521b6b01-1124-44b3-a7e6-511f4c5db02b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:23:58 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:23:58 devstack quobyte-client[79699]: System call "ioctl" of process 91753 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:23:58 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=105, name=volume-521b6b01-1124-44b3-a7e6-511f4c5db02b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b 1073741824" returned: 0 in 0.116s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] <== create_volume: return (141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.143s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b50ce1-6e52-4ea4-8dc9-036167e79a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-521b6b01-1124-44b3-a7e6-511f4c5db02b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dcd8b8-8be0-46bc-a305-dbbf68a7a9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:23:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Volume volume-521b6b01-1124-44b3-a7e6-511f4c5db02b (521b6b01-1124-44b3-a7e6-511f4c5db02b): created successfully
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dcd8b8-8be0-46bc-a305-dbbf68a7a9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:23:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Flow 'volume_create_manager' (314e7bb5-efda-451f-aad4-3dd627ee8114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:23:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-42afa28d-c651-456b-870d-0cb8bf664aa8 tempest-AttachVolumeNegativeTest-2098133805 None] Created volume successfully.
Sep 30 20:24:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-b4cac611-8a95-4733-af9d-9e8da8071458 req-167e3612-7871-46a7-90ce-3cb887c342dd tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:24:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-b4cac611-8a95-4733-af9d-9e8da8071458 req-167e3612-7871-46a7-90ce-3cb887c342dd tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:24:02 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ecf821-e205-4ea0-980b-430c7df35a4e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:24:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-b4cac611-8a95-4733-af9d-9e8da8071458 req-167e3612-7871-46a7-90ce-3cb887c342dd tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:24:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-b4cac611-8a95-4733-af9d-9e8da8071458 req-167e3612-7871-46a7-90ce-3cb887c342dd tempest-AttachVolumeNegativeTest-2098133805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b" returned: 0 in 0.134s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:24:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-b4cac611-8a95-4733-af9d-9e8da8071458 req-167e3612-7871-46a7-90ce-3cb887c342dd tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.143s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:24:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-b4cac611-8a95-4733-af9d-9e8da8071458 req-167e3612-7871-46a7-90ce-3cb887c342dd tempest-AttachVolumeNegativeTest-2098133805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-521b6b01-1124-44b3-a7e6-511f4c5db02b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9244c6d5-fd95-4500-a681-769197be44f7', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:24:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-b4cac611-8a95-4733-af9d-9e8da8071458 req-167e3612-7871-46a7-90ce-3cb887c342dd tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:24:02 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-b4cac611-8a95-4733-af9d-9e8da8071458 req-167e3612-7871-46a7-90ce-3cb887c342dd tempest-AttachVolumeNegativeTest-2098133805 None] attachment_update completed successfully.
Sep 30 20:24:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:24:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:24:12 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:24:12 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:24:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:24:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:24:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-9dff24ca-2d4a-4b79-8e26-0c1934858ac6 req-b719f5ea-9441-41af-88f5-d3581c289ae5 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:24:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-9dff24ca-2d4a-4b79-8e26-0c1934858ac6 req-b719f5ea-9441-41af-88f5-d3581c289ae5 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:24:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-9dff24ca-2d4a-4b79-8e26-0c1934858ac6 req-b719f5ea-9441-41af-88f5-d3581c289ae5 tempest-AttachVolumeNegativeTest-2098133805 None] Terminate volume connection completed successfully.
Sep 30 20:24:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-9dff24ca-2d4a-4b79-8e26-0c1934858ac6 req-b719f5ea-9441-41af-88f5-d3581c289ae5 tempest-AttachVolumeNegativeTest-2098133805 None] Deleting attachment 9244c6d5-fd95-4500-a681-769197be44f7. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:24:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:24:39 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:24:39 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:24:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:24:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.064s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:24:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:24:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:25:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:25:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:25:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:25:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:25:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Flow 'volume_create_manager' (6b86b0cd-0c2a-4876-a330-9652e3c508dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c28cea9-3b1c-4724-8c47-65eb9c1d1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c28cea9-3b1c-4724-8c47-65eb9c1d1737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1430314685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9759e1c5-9dcb-4076-beb9-e9eb50f2e815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62495123145431eae3b4d069dc6238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:25:58Z,use_quota=True,user_id='fd59ef80c1944c9baf9ce0461b65b738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e7700c-4165-4ca2-822c-20c011c3c965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e7700c-4165-4ca2-822c-20c011c3c965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a90aa4e-726a-4816-9ec3-bfbc1b1a5bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a90aa4e-726a-4816-9ec3-bfbc1b1a5bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9759e1c5-9dcb-4076-beb9-e9eb50f2e815', 'volume_name': 'volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92574710-7251-47f1-a28b-1f08e491a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92574710-7251-47f1-a28b-1f08e491a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e9dccc-6073-4ee9-ba48-736d3c83c82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:25:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Volume 9759e1c5-9dcb-4076-beb9-e9eb50f2e815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815', 'volume_size': 1}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1430314685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9759e1c5-9dcb-4076-beb9-e9eb50f2e815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62495123145431eae3b4d069dc6238f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:25:58Z,use_quota=True,user_id='fd59ef80c1944c9baf9ce0461b65b738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Creating volume 9759e1c5-9dcb-4076-beb9-e9eb50f2e815 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:25:58 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:25:58 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=106, name=volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815 1073741824" returned: 0 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] <== create_volume: return (144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.147s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e9dccc-6073-4ee9-ba48-736d3c83c82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed662d1-2198-4a7d-b4d5-f5c9d8e0edf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:25:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Volume volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815 (9759e1c5-9dcb-4076-beb9-e9eb50f2e815): created successfully
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed662d1-2198-4a7d-b4d5-f5c9d8e0edf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:25:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Flow 'volume_create_manager' (6b86b0cd-0c2a-4876-a330-9652e3c508dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:25:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6d386f68-822d-43f6-a215-4b1a65282a4e tempest-AttachVolumeNegativeTest-2098133805 None] Created volume successfully.
Sep 30 20:26:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e38d4a23-48c0-4b5f-b186-bcb3ad0bc3bd req-d8bc1479-d6ff-4fca-a6ba-41cf9d877f46 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e38d4a23-48c0-4b5f-b186-bcb3ad0bc3bd req-d8bc1479-d6ff-4fca-a6ba-41cf9d877f46 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:02 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bcf60a-7aca-4c9b-83dc-0784e3f1fe72]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-e38d4a23-48c0-4b5f-b186-bcb3ad0bc3bd req-d8bc1479-d6ff-4fca-a6ba-41cf9d877f46 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-e38d4a23-48c0-4b5f-b186-bcb3ad0bc3bd req-d8bc1479-d6ff-4fca-a6ba-41cf9d877f46 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-e38d4a23-48c0-4b5f-b186-bcb3ad0bc3bd req-d8bc1479-d6ff-4fca-a6ba-41cf9d877f46 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.135s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-e38d4a23-48c0-4b5f-b186-bcb3ad0bc3bd req-d8bc1479-d6ff-4fca-a6ba-41cf9d877f46 tempest-AttachVolumeNegativeTest-2098133805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42b63d3a-4b39-4fc0-a826-00a421ebda17', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:26:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-e38d4a23-48c0-4b5f-b186-bcb3ad0bc3bd req-d8bc1479-d6ff-4fca-a6ba-41cf9d877f46 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:02 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-e38d4a23-48c0-4b5f-b186-bcb3ad0bc3bd req-d8bc1479-d6ff-4fca-a6ba-41cf9d877f46 tempest-AttachVolumeNegativeTest-2098133805 None] attachment_update completed successfully.
Sep 30 20:26:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:26:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:26:12 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:26:12 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:26:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:26:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:26:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-f3e720e9-3b81-4690-a81d-004cb22f25db req-3b4d8ded-a675-492f-8255-48a061130a95 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-f3e720e9-3b81-4690-a81d-004cb22f25db req-3b4d8ded-a675-492f-8255-48a061130a95 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-f3e720e9-3b81-4690-a81d-004cb22f25db req-3b4d8ded-a675-492f-8255-48a061130a95 tempest-AttachVolumeNegativeTest-2098133805 None] Terminate volume connection completed successfully.
Sep 30 20:26:29 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-f3e720e9-3b81-4690-a81d-004cb22f25db req-3b4d8ded-a675-492f-8255-48a061130a95 tempest-AttachVolumeNegativeTest-2098133805 None] Deleting attachment 42b63d3a-4b39-4fc0-a826-00a421ebda17. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:26:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "cinder-9759e1c5-9dcb-4076-beb9-e9eb50f2e815-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-9759e1c5-9dcb-4076-beb9-e9eb50f2e815-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:38 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "cinder-quobyte-9759e1c5-9dcb-4076-beb9-e9eb50f2e815" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-quobyte-9759e1c5-9dcb-4076-beb9-e9eb50f2e815" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac80fa26-e3b8-4ef9-937c-0e64e947750a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815" returned: 0 in 0.130s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9759e1c5-9dcb-4076-beb9-e9eb50f2e815" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-quobyte-9759e1c5-9dcb-4076-beb9-e9eb50f2e815" released by "delete_volume" :: held 0.174s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Created reservations ['564b04a3-1b58-496a-b78f-b0c6d47b5c45', '8eec3176-34a2-4eb0-9ced-56836ac6b696', 'ac92a3e7-1cbc-4f70-8117-c4d543c143c8', '131d9849-c7e7-4640-ac62-14f976bfa0f9'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:26:38 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Deleted volume successfully.
Sep 30 20:26:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-07e748eb-2ec8-4c15-a8ad-27b3f6e6e926 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-9759e1c5-9dcb-4076-beb9-e9eb50f2e815-delete_volume" released by "delete_volume" :: held 0.305s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "cinder-521b6b01-1124-44b3-a7e6-511f4c5db02b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-521b6b01-1124-44b3-a7e6-511f4c5db02b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:39 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "cinder-quobyte-521b6b01-1124-44b3-a7e6-511f4c5db02b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-quobyte-521b6b01-1124-44b3-a7e6-511f4c5db02b" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9460b8c-30de-48a1-8444-ea35a5c4ab74]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b" returned: 0 in 0.135s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-521b6b01-1124-44b3-a7e6-511f4c5db02b" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-quobyte-521b6b01-1124-44b3-a7e6-511f4c5db02b" released by "delete_volume" :: held 0.174s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Created reservations ['370e0aac-85ee-4482-86b2-5d998508e160', '6e71905b-af65-4af2-99d3-cd88bfbef302', '4628d692-9249-4725-9aa0-17474f34bf45', 'db04b917-2cf1-42eb-9d88-67f19bbb2abd'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:26:40 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Deleted volume successfully.
Sep 30 20:26:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e872db6e-af32-4d18-aff5-f62b8f6f2dca tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-521b6b01-1124-44b3-a7e6-511f4c5db02b-delete_volume" released by "delete_volume" :: held 0.309s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "cinder-41b9afbc-fc79-4340-8314-086fa5140c25-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-41b9afbc-fc79-4340-8314-086fa5140c25-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:41 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "cinder-quobyte-41b9afbc-fc79-4340-8314-086fa5140c25" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-quobyte-41b9afbc-fc79-4340-8314-086fa5140c25" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a916ea6-ee71-4f1b-b4eb-6e30a7d41a2d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-41b9afbc-fc79-4340-8314-086fa5140c25" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-quobyte-41b9afbc-fc79-4340-8314-086fa5140c25" released by "delete_volume" :: held 0.164s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Created reservations ['80e4650f-9931-4e27-a37d-dd08ef00a1ec', 'b2cb2bf9-fda3-4cdc-bcee-89995c281833', 'a3955e19-5a42-429e-b045-259dd95d6588', '4e9b935a-79c5-4a39-ad80-2130d0bbb2da'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:26:41 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Deleted volume successfully.
Sep 30 20:26:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5b018974-9e4f-4e51-ae5f-bef5fd8f51b2 tempest-AttachVolumeNegativeTest-2098133805 None] Lock "cinder-41b9afbc-fc79-4340-8314-086fa5140c25-delete_volume" released by "delete_volume" :: held 0.311s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:26:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b837660f-6c0f-4a64-97a3-b790b39b0183 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b837660f-6c0f-4a64-97a3-b790b39b0183 tempest-GroupSnapshotsTest-2043077670 None] Group tempest-GroupSnapshotsTest-Group-671790150: creating
Sep 30 20:26:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b837660f-6c0f-4a64-97a3-b790b39b0183 tempest-GroupSnapshotsTest-2043077670 None] Group tempest-GroupSnapshotsTest-Group-671790150: created successfully
Sep 30 20:26:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b837660f-6c0f-4a64-97a3-b790b39b0183 tempest-GroupSnapshotsTest-2043077670 None] Create group completed successfully.
Sep 30 20:26:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Flow 'volume_create_manager' (7dd219c0-2913-4762-81e3-bdeea184a853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d394c54-3f36-4b01-b264-fe4964c4e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d394c54-3f36-4b01-b264-fe4964c4e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1097153722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1a842d79-cb34-4230-b854-82ba4b3488f6,host='devstack@QuobyteHD#QuobyteHD',id=48a0a523-e0f8-4e76-b92c-293737b38209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def8fb8d81449728e57d6235aded78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:26:48Z,use_quota=True,user_id='00b6414f39194ffc8583158102ebbfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b93f382a-5e1b-47e6-ab81-73d490c3baa2),volume_type_id=b93f382a-5e1b-47e6-ab81-73d490c3baa2)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8571293a-7a34-4dbc-b537-b688d52febed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8571293a-7a34-4dbc-b537-b688d52febed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a61cfe-a3e2-4399-ab35-5357bbc54959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a61cfe-a3e2-4399-ab35-5357bbc54959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a0a523-e0f8-4e76-b92c-293737b38209', 'volume_name': 'volume-48a0a523-e0f8-4e76-b92c-293737b38209', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8db43ff-b53d-4aec-9012-d6d8ca9ed428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8db43ff-b53d-4aec-9012-d6d8ca9ed428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6004e928-e240-49c4-8543-4ec07bd8b92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:47 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Volume 48a0a523-e0f8-4e76-b92c-293737b38209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a0a523-e0f8-4e76-b92c-293737b38209', 'volume_size': 1}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1a842d79-cb34-4230-b854-82ba4b3488f6,created_at=2025-09-30T18:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1097153722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1a842d79-cb34-4230-b854-82ba4b3488f6,host='devstack@QuobyteHD#QuobyteHD',id=48a0a523-e0f8-4e76-b92c-293737b38209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def8fb8d81449728e57d6235aded78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:26:48Z,use_quota=True,user_id='00b6414f39194ffc8583158102ebbfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b93f382a-5e1b-47e6-ab81-73d490c3baa2),volume_type_id=b93f382a-5e1b-47e6-ab81-73d490c3baa2)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Creating volume 48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:26:47 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:47 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=107, name=volume-48a0a523-e0f8-4e76-b92c-293737b38209, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:26:47 devstack quobyte-client[79699]: System call "getattr" of process 93264 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:26:47 devstack quobyte-client[79699]: System call "lookup" of process 93264 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:26:47 devstack quobyte-client[79699]: System call "getattr" of process 93264 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:26:47 devstack quobyte-client[79699]: System call "open" of process 93264 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 1073741824" returned: 0 in 0.112s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209" returned: 0 in 0.015s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] <== create_volume: return (134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.136s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6004e928-e240-49c4-8543-4ec07bd8b92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a0a523-e0f8-4e76-b92c-293737b38209', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:47 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978abd9-491d-4737-9d12-5fb6409880d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:48 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Volume volume-48a0a523-e0f8-4e76-b92c-293737b38209 (48a0a523-e0f8-4e76-b92c-293737b38209): created successfully
Sep 30 20:26:48 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a978abd9-491d-4737-9d12-5fb6409880d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:48 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Flow 'volume_create_manager' (7dd219c0-2913-4762-81e3-bdeea184a853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:26:48 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0f147623-1b11-41c6-81cf-427996f7e0f2 tempest-GroupSnapshotsTest-2043077670 None] Created volume successfully.
Sep 30 20:26:48 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] GroupSnapshot aa81ef6d-afd5-47b9-9690-77d55ddb9b1d: creating.
Sep 30 20:26:49 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Group snapshot aa81ef6d-afd5-47b9-9690-77d55ddb9b1d: creating. {{(pid=79893) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Creating offline snapshot a692b2af-850a-47ba-9c5d-5909ed6ee807 of volume 48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[be683b41-44c8-448f-ba30-fd85e713dd16]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209" returned: 0 in 0.122s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:49 devstack quobyte-client[79699]: System call "getattr" of process 93271 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:26:49 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=108, name=volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:26:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 1G" returned: 0 in 0.079s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img rebase -u -b volume-48a0a523-e0f8-4e76-b92c-293737b38209 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img rebase -u -b volume-48a0a523-e0f8-4e76-b92c-293737b38209 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807" returned: 0 in 0.015s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.info" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.info" returned: 0 in 0.015s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.337s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:49 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-24b0be1a-5dba-410e-86d4-1fed8e20202f tempest-GroupSnapshotsTest-2043077670 None] group_snapshot aa81ef6d-afd5-47b9-9690-77d55ddb9b1d: created successfully
Sep 30 20:26:50 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-a692b2af-850a-47ba-9c5d-5909ed6ee807-925cb6b8-5413-409d-8057-418a43b613d6" by "_create_volume_from_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-a692b2af-850a-47ba-9c5d-5909ed6ee807-925cb6b8-5413-409d-8057-418a43b613d6" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Creating volume 925cb6b8-5413-409d-8057-418a43b613d6 from snapshot a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-925cb6b8-5413-409d-8057-418a43b613d6" by "_copy_volume_from_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-925cb6b8-5413-409d-8057-418a43b613d6" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] snapshot: a692b2af-850a-47ba-9c5d-5909ed6ee807, volume: 925cb6b8-5413-409d-8057-418a43b613d6,  {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:50 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[85156a2f-4baf-4a5a-b53e-4ccce9daeef2]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807" returned: 0 in 0.143s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48a0a523-e0f8-4e76-b92c-293737b38209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Creating direct copy from snapshot {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bccca6f-5fa5-4664-8abd-e0143549058c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:51 devstack quobyte-client[79699]: System call "getattr" of process 93284 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209" returned: 0 in 0.141s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG cinder.utils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6 not found in is_blk_device check {{(pid=79893) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:51 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=110, name=volume-925cb6b8-5413-409d-8057-418a43b613d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.062s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6" returned: 0 in 1.340s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe68613-8b85-44f0-9f6b-946f4829fda1]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209" returned: 0 in 0.241s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209, size 1024.00 MB, duration 1.34 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6 {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:26:52 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Converted 1024.00 MB image at 763.48 MB/s
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-925cb6b8-5413-409d-8057-418a43b613d6" released by "_copy_volume_from_snapshot" :: held 1.942s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-a692b2af-850a-47ba-9c5d-5909ed6ee807-925cb6b8-5413-409d-8057-418a43b613d6" released by "_create_volume_from_snapshot" :: held 1.958s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:52 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.968s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:52 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f9b8c7c8-99e7-42a8-96b7-287ed7855697 tempest-GroupSnapshotsTest-2043077670 None] Create group from source-snapshot-aa81ef6d-afd5-47b9-9690-77d55ddb9b1d completed successfully.
Sep 30 20:26:53 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-925cb6b8-5413-409d-8057-418a43b613d6" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-925cb6b8-5413-409d-8057-418a43b613d6" acquired by "delete_volume" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[14473e2f-c3e7-44d4-92af-7b5a3d35c5a1]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6" returned: 0 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-925cb6b8-5413-409d-8057-418a43b613d6" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-925cb6b8-5413-409d-8057-418a43b613d6" released by "delete_volume" :: held 0.172s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['519c8449-bd0c-44ed-b4b8-82c8db4cd501'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:26:53 devstack cinder-volume[79893]: WARNING cinder.quota [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-78651816 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-78651816, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:26:53 devstack cinder-volume[79893]: WARNING cinder.quota [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-78651816 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-78651816, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['be1efdd0-05a9-4f29-bc88-8027a36c05fa', '60041af0-98bd-48ba-85c7-8083afafa5ad', 'd041852f-32e7-4e94-ab4f-21489c438c8e', 'b6d42124-15a9-406a-9b27-96c1c9fa2997'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.015s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:53 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:26:53 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-132e4b2e-9ae5-46d5-b98a-00db36e5d31c tempest-GroupSnapshotsTest-2043077670 None] Delete group completed successfully.
Sep 30 20:26:54 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] group_snapshot aa81ef6d-afd5-47b9-9690-77d55ddb9b1d: deleting
Sep 30 20:26:54 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] group_snapshot aa81ef6d-afd5-47b9-9690-77d55ddb9b1d: deleting {{(pid=79893) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-48a0a523-e0f8-4e76-b92c-293737b38209" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-48a0a523-e0f8-4e76-b92c-293737b38209" acquired by "delete_snapshot" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-a692b2af-850a-47ba-9c5d-5909ed6ee807" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-a692b2af-850a-47ba-9c5d-5909ed6ee807" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Deleting offline snapshot a692b2af-850a-47ba-9c5d-5909ed6ee807 of volume 48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] snapshot_file for this snap is: volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[898af7b1-c6f5-4442-a8b8-4eadceb9e2ef]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48a0a523-e0f8-4e76-b92c-293737b38209(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d06739a-ef1d-4b5b-99bf-ea92aa9d14ee]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209" returned: 0 in 0.130s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:54 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:54 devstack quobyte-client[79699]: System call "open" of process 93314 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807" returned: 0 in 0.057s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209.a692b2af-850a-47ba-9c5d-5909ed6ee807" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-a692b2af-850a-47ba-9c5d-5909ed6ee807" released by "_delete_snapshot" :: held 0.381s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-48a0a523-e0f8-4e76-b92c-293737b38209" released by "delete_snapshot" :: held 0.393s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:55 devstack cinder-volume[79893]: WARNING cinder.quota [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-78651816 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-78651816, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['a33c2ceb-4408-4d3e-a4db-b4c0d5081d1c', '30811ee2-09e7-436b-a35b-93ec53774512', '1a0507da-7073-403e-899a-f6a710879dea', '5d48abff-7a08-4310-adec-623380811c75'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:26:55 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e812df2b-f076-4c7d-93e9-d1540918e49e tempest-GroupSnapshotsTest-2043077670 None] group_snapshot aa81ef6d-afd5-47b9-9690-77d55ddb9b1d: deleted successfully
Sep 30 20:26:55 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-48a0a523-e0f8-4e76-b92c-293737b38209" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-48a0a523-e0f8-4e76-b92c-293737b38209" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea743f2f-c8cd-4b5f-b61e-e313ce7cee5c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:26:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48a0a523-e0f8-4e76-b92c-293737b38209" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-48a0a523-e0f8-4e76-b92c-293737b38209" released by "delete_volume" :: held 0.174s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['c5badc0a-bb6e-4d65-9c52-0a968431e1c6'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:26:56 devstack cinder-volume[79893]: WARNING cinder.db.sqlalchemy.api [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-78651816']
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['cd6d2eb2-b305-4638-8017-663ae0bea3c9', 'a4e2e98e-328d-4fa7-bdc8-c840250c8450', 'c93fb7a2-bfaf-4036-bd77-80d4a44d78f6', '745f6578-514e-4865-b818-163593aade6e'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:56 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:26:56 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-97b86ca2-b436-4e41-a173-b7f32be622d5 tempest-GroupSnapshotsTest-2043077670 None] Delete group completed successfully.
Sep 30 20:26:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:26:57 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-fa8fe217-8b9f-4165-a29b-3e055ca0fa3c tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-fa8fe217-8b9f-4165-a29b-3e055ca0fa3c tempest-GroupSnapshotsTest-2043077670 None] Group tempest-GroupSnapshotsTest-Group-1474333692: creating
Sep 30 20:26:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-fa8fe217-8b9f-4165-a29b-3e055ca0fa3c tempest-GroupSnapshotsTest-2043077670 None] Group tempest-GroupSnapshotsTest-Group-1474333692: created successfully
Sep 30 20:26:57 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-fa8fe217-8b9f-4165-a29b-3e055ca0fa3c tempest-GroupSnapshotsTest-2043077670 None] Create group completed successfully.
Sep 30 20:26:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Flow 'volume_create_manager' (8f806f79-265f-47ad-860a-79ba52850c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ea62f4-ae67-4e74-b700-f87014babd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ea62f4-ae67-4e74-b700-f87014babd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1227924946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=efb9bfc3-1e9f-4b4b-9061-d9d4145c4e52,host='devstack@QuobyteHD#QuobyteHD',id=ebba0074-bdb9-463f-80f0-e38ce1baf2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def8fb8d81449728e57d6235aded78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:26:59Z,use_quota=True,user_id='00b6414f39194ffc8583158102ebbfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d76ecc64-9c8a-433a-aed0-70652584b2a2),volume_type_id=d76ecc64-9c8a-433a-aed0-70652584b2a2)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e6376c-c276-4f38-bb60-2ac44dc19db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e6376c-c276-4f38-bb60-2ac44dc19db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dd17e7-24a8-40da-a8c4-385bf030e057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dd17e7-24a8-40da-a8c4-385bf030e057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebba0074-bdb9-463f-80f0-e38ce1baf2ba', 'volume_name': 'volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c2c8a2-6031-467d-a23e-52593b55a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c2c8a2-6031-467d-a23e-52593b55a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66d702f-9c18-493d-93af-e4f5bbee1bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Volume ebba0074-bdb9-463f-80f0-e38ce1baf2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba', 'volume_size': 1}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=efb9bfc3-1e9f-4b4b-9061-d9d4145c4e52,created_at=2025-09-30T18:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1227924946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=efb9bfc3-1e9f-4b4b-9061-d9d4145c4e52,host='devstack@QuobyteHD#QuobyteHD',id=ebba0074-bdb9-463f-80f0-e38ce1baf2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def8fb8d81449728e57d6235aded78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:26:59Z,use_quota=True,user_id='00b6414f39194ffc8583158102ebbfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d76ecc64-9c8a-433a-aed0-70652584b2a2),volume_type_id=d76ecc64-9c8a-433a-aed0-70652584b2a2)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Creating volume ebba0074-bdb9-463f-80f0-e38ce1baf2ba {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:26:58 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:58 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=111, name=volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba 1073741824" returned: 0 in 0.103s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] <== create_volume: return (129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.132s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66d702f-9c18-493d-93af-e4f5bbee1bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86fd325-45bf-4b87-89b6-b8ba78befbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Volume volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba (ebba0074-bdb9-463f-80f0-e38ce1baf2ba): created successfully
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86fd325-45bf-4b87-89b6-b8ba78befbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Flow 'volume_create_manager' (8f806f79-265f-47ad-860a-79ba52850c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:26:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0b44032b-a8a8-4243-9da9-9692f9d4daae tempest-GroupSnapshotsTest-2043077670 None] Created volume successfully.
Sep 30 20:26:59 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Flow 'volume_create_manager' (24669fc3-de14-435c-967e-0c8501eb5492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a6b148-b9f3-44ab-ac33-6dacea493b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a6b148-b9f3-44ab-ac33-6dacea493b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-307097622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=efb9bfc3-1e9f-4b4b-9061-d9d4145c4e52,host='devstack@QuobyteHD#QuobyteHD',id=1f8bc94c-f355-49b9-9160-0497bbfce5fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def8fb8d81449728e57d6235aded78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:00Z,use_quota=True,user_id='00b6414f39194ffc8583158102ebbfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d76ecc64-9c8a-433a-aed0-70652584b2a2),volume_type_id=d76ecc64-9c8a-433a-aed0-70652584b2a2)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2fb2c7-2021-42a3-be4b-7f56ea4479b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2fb2c7-2021-42a3-be4b-7f56ea4479b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71af908b-f9a3-4bd0-ae12-c2c3968e5e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71af908b-f9a3-4bd0-ae12-c2c3968e5e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8bc94c-f355-49b9-9160-0497bbfce5fa', 'volume_name': 'volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5b173c-cd89-4fcb-8e8a-0dfa0f6a506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5b173c-cd89-4fcb-8e8a-0dfa0f6a506f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c35324-a9da-4e81-8737-aa18146dc048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:26:59 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Volume 1f8bc94c-f355-49b9-9160-0497bbfce5fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa', 'volume_size': 1}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=efb9bfc3-1e9f-4b4b-9061-d9d4145c4e52,created_at=2025-09-30T18:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-307097622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=efb9bfc3-1e9f-4b4b-9061-d9d4145c4e52,host='devstack@QuobyteHD#QuobyteHD',id=1f8bc94c-f355-49b9-9160-0497bbfce5fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def8fb8d81449728e57d6235aded78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:00Z,use_quota=True,user_id='00b6414f39194ffc8583158102ebbfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d76ecc64-9c8a-433a-aed0-70652584b2a2),volume_type_id=d76ecc64-9c8a-433a-aed0-70652584b2a2)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Creating volume 1f8bc94c-f355-49b9-9160-0497bbfce5fa {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:26:59 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:26:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:26:59 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=112, name=volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa 1073741824" returned: 0 in 0.100s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] <== create_volume: return (125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.128s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c35324-a9da-4e81-8737-aa18146dc048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e1094b-7501-40e9-a4a0-adbfbc7cd016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:00 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Volume volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa (1f8bc94c-f355-49b9-9160-0497bbfce5fa): created successfully
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e1094b-7501-40e9-a4a0-adbfbc7cd016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Flow 'volume_create_manager' (24669fc3-de14-435c-967e-0c8501eb5492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:00 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ec440399-0af6-43a8-beef-8ebf7aa43a3b tempest-GroupSnapshotsTest-2043077670 None] Created volume successfully.
Sep 30 20:27:01 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3492cc46-9e37-49ed-9e7b-85c510007709 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:01 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3492cc46-9e37-49ed-9e7b-85c510007709 tempest-GroupSnapshotsTest-2043077670 None] Update group completed successfully.
Sep 30 20:27:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e625f6bd-4e07-4606-8745-13d5ffa4d4fa tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:02 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e625f6bd-4e07-4606-8745-13d5ffa4d4fa tempest-GroupSnapshotsTest-2043077670 None] Update group completed successfully.
Sep 30 20:27:03 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5a6004cf-0efb-4ba7-9471-7afb37ac43ed tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:03 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5a6004cf-0efb-4ba7-9471-7afb37ac43ed tempest-GroupSnapshotsTest-2043077670 None] Update group completed successfully.
Sep 30 20:27:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:27:04 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-874fe5a2-d777-4dce-8a8c-fc5c8d24bc60 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:04 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-874fe5a2-d777-4dce-8a8c-fc5c8d24bc60 tempest-GroupSnapshotsTest-2043077670 None] Update group completed successfully.
Sep 30 20:27:05 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] GroupSnapshot 7ed68604-eb30-4ada-81d5-84fc50d552fd: creating.
Sep 30 20:27:05 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Group snapshot 7ed68604-eb30-4ada-81d5-84fc50d552fd: creating. {{(pid=79893) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Creating offline snapshot adbd541b-17b5-49e8-abf6-37b667ffa44a of volume 1f8bc94c-f355-49b9-9160-0497bbfce5fa {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea9abc-e6f5-4acb-a150-06a0c7aa29fe]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa" returned: 0 in 0.134s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:05 devstack quobyte-client[79699]: System call "getlk" of process 93335 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:05 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=113, name=volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a 1G" returned: 0 in 0.089s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img rebase -u -b volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.info" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.info" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.373s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Creating offline snapshot c7b33fea-ebb6-4f34-871a-7ff0215ca546 of volume ebba0074-bdb9-463f-80f0-e38ce1baf2ba {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0b6cd7-f091-425b-84ae-38043f49d06d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:06 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=115, name=volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 1G" returned: 0 in 0.089s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img rebase -u -b volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546" returned: 0 in 0.035s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.info" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.info" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.363s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-38e1c66d-a3a6-4768-bdc7-011d86918354 tempest-GroupSnapshotsTest-2043077670 None] group_snapshot 7ed68604-eb30-4ada-81d5-84fc50d552fd: created successfully
Sep 30 20:27:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] group_snapshot 7ed68604-eb30-4ada-81d5-84fc50d552fd: deleting
Sep 30 20:27:06 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] group_snapshot 7ed68604-eb30-4ada-81d5-84fc50d552fd: deleting {{(pid=79893) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-1f8bc94c-f355-49b9-9160-0497bbfce5fa" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-1f8bc94c-f355-49b9-9160-0497bbfce5fa" acquired by "delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-adbd541b-17b5-49e8-abf6-37b667ffa44a" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-adbd541b-17b5-49e8-abf6-37b667ffa44a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Deleting offline snapshot adbd541b-17b5-49e8-abf6-37b667ffa44a of volume 1f8bc94c-f355-49b9-9160-0497bbfce5fa {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] snapshot_file for this snap is: volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ef5b78-971d-4852-9334-19364593f2b4]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9652d6-08a4-4d77-89c6-78190dbcf648]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a" returned: 0 in 0.057s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa.adbd541b-17b5-49e8-abf6-37b667ffa44a" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-adbd541b-17b5-49e8-abf6-37b667ffa44a" released by "_delete_snapshot" :: held 0.396s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-1f8bc94c-f355-49b9-9160-0497bbfce5fa" released by "delete_snapshot" :: held 0.409s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" acquired by "delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-c7b33fea-ebb6-4f34-871a-7ff0215ca546" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-c7b33fea-ebb6-4f34-871a-7ff0215ca546" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Deleting offline snapshot c7b33fea-ebb6-4f34-871a-7ff0215ca546 of volume ebba0074-bdb9-463f-80f0-e38ce1baf2ba {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] snapshot_file for this snap is: volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be155e8-b76d-4a43-99da-ba0d60af5d55]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546" returned: 0 in 0.118s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f2ca4d-2a7b-478b-ae1a-433c46b1c231]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:07 devstack quobyte-client[79699]: System call "getattr" of process 93375 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546" returned: 0 in 0.064s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba.c7b33fea-ebb6-4f34-871a-7ff0215ca546" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-c7b33fea-ebb6-4f34-871a-7ff0215ca546" released by "_delete_snapshot" :: held 0.373s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" released by "delete_snapshot" :: held 0.382s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:07 devstack cinder-volume[79893]: WARNING cinder.quota [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1071614947 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1071614947, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:27:07 devstack cinder-volume[79893]: WARNING cinder.quota [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1071614947 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1071614947, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['84ff69d0-8067-410c-b432-734dfe8570e0', '32289359-26b5-4da1-ab47-a32d3a2d41cc', '623cd1bf-4f87-485f-afa3-81dfeb4251a5', '7afbfb03-63ac-4ff7-bb45-df2f93e7ffe6'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:07 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['8cffd2f8-44fb-4390-adfc-78b396f605ad', '645379d6-bda5-4b11-bda0-6a5cf9fd7467', 'e0bb6c54-f133-4776-8784-c560d72d2fe2', '50d13c4c-8d5d-4e0a-b930-2a8446427a23'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:07 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-83318fce-59f6-4d57-b5a7-71232607b48d tempest-GroupSnapshotsTest-2043077670 None] group_snapshot 7ed68604-eb30-4ada-81d5-84fc50d552fd: deleted successfully
Sep 30 20:27:08 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-1f8bc94c-f355-49b9-9160-0497bbfce5fa" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-1f8bc94c-f355-49b9-9160-0497bbfce5fa" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a1c9a8-0b91-43b0-b328-8b2388d9ad7d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1f8bc94c-f355-49b9-9160-0497bbfce5fa" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-1f8bc94c-f355-49b9-9160-0497bbfce5fa" released by "delete_volume" :: held 0.185s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7c4e2b-e46b-4666-950a-80c03ac55512]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-ebba0074-bdb9-463f-80f0-e38ce1baf2ba" released by "delete_volume" :: held 0.172s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['643fc063-bb6b-4e4d-855e-4c0c9d322b59'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:08 devstack cinder-volume[79893]: WARNING cinder.quota [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1071614947 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1071614947, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['6d1b3baa-c4c4-48a6-9fdf-a9b39c4e5aa4', 'be0282c1-0d25-4c80-84f4-ceb0316170bc', 'fe6db537-bdb4-4c06-89de-f3c728e3041e', 'a5b5329c-1c31-4f26-b996-acef1d7342dc'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['9ef55eaf-9c08-4c0f-950c-53bd1e929215', '055cea74-eee5-46c8-8b71-65629e14d9e6', '58b07ecf-be43-419f-92af-6609a610a722', '66286021-ccda-4981-85b4-94db2c779538'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:08 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:27:08 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-4da3ccdf-b7c6-4deb-ab7e-ad13a7309e0e tempest-GroupSnapshotsTest-2043077670 None] Delete group completed successfully.
Sep 30 20:27:09 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f36c4941-9a08-4db1-b212-35730c003034 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:09 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f36c4941-9a08-4db1-b212-35730c003034 tempest-GroupSnapshotsTest-2043077670 None] Group tempest-GroupSnapshotsTest-Group-1769265130: creating
Sep 30 20:27:09 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f36c4941-9a08-4db1-b212-35730c003034 tempest-GroupSnapshotsTest-2043077670 None] Group tempest-GroupSnapshotsTest-Group-1769265130: created successfully
Sep 30 20:27:09 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f36c4941-9a08-4db1-b212-35730c003034 tempest-GroupSnapshotsTest-2043077670 None] Create group completed successfully.
Sep 30 20:27:10 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Flow 'volume_create_manager' (50d2a3e5-f596-4d1f-a68b-7359682c9edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8f8fe8-910e-4b2f-86a4-f84e91d1d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf8f8fe8-910e-4b2f-86a4-f84e91d1d92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-747322757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=caae7528-1107-4880-be37-ab004ebd0e9c,host='devstack@QuobyteHD#QuobyteHD',id=869e7fe6-f98f-42d6-bd75-498ecd566fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def8fb8d81449728e57d6235aded78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:11Z,use_quota=True,user_id='00b6414f39194ffc8583158102ebbfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0efc9e9-0d71-4037-87d4-3b78e5a42f3a),volume_type_id=f0efc9e9-0d71-4037-87d4-3b78e5a42f3a)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca3e500-e4d0-48b2-84d9-24dd420da505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca3e500-e4d0-48b2-84d9-24dd420da505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4bf264-3241-4e2d-bcf7-602284e25489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4bf264-3241-4e2d-bcf7-602284e25489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869e7fe6-f98f-42d6-bd75-498ecd566fae', 'volume_name': 'volume-869e7fe6-f98f-42d6-bd75-498ecd566fae', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951b9b5e-0769-4d6d-8103-bb3fe7585b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (951b9b5e-0769-4d6d-8103-bb3fe7585b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6699d7f3-460e-4786-a401-0deb9b65de85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:10 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Volume 869e7fe6-f98f-42d6-bd75-498ecd566fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869e7fe6-f98f-42d6-bd75-498ecd566fae', 'volume_size': 1}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=caae7528-1107-4880-be37-ab004ebd0e9c,created_at=2025-09-30T18:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-747322757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=caae7528-1107-4880-be37-ab004ebd0e9c,host='devstack@QuobyteHD#QuobyteHD',id=869e7fe6-f98f-42d6-bd75-498ecd566fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0def8fb8d81449728e57d6235aded78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:11Z,use_quota=True,user_id='00b6414f39194ffc8583158102ebbfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0efc9e9-0d71-4037-87d4-3b78e5a42f3a),volume_type_id=f0efc9e9-0d71-4037-87d4-3b78e5a42f3a)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Creating volume 869e7fe6-f98f-42d6-bd75-498ecd566fae {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:27:10 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:10 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=117, name=volume-869e7fe6-f98f-42d6-bd75-498ecd566fae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae 1073741824" returned: 0 in 0.105s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] <== create_volume: return (130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.132s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6699d7f3-460e-4786-a401-0deb9b65de85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869e7fe6-f98f-42d6-bd75-498ecd566fae', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8191cc-13a1-4cf8-b234-31e2f767f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:10 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Volume volume-869e7fe6-f98f-42d6-bd75-498ecd566fae (869e7fe6-f98f-42d6-bd75-498ecd566fae): created successfully
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8191cc-13a1-4cf8-b234-31e2f767f334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Flow 'volume_create_manager' (50d2a3e5-f596-4d1f-a68b-7359682c9edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:10 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-effb2b2d-bc86-4872-b8da-f97dbabc1ffa tempest-GroupSnapshotsTest-2043077670 None] Created volume successfully.
Sep 30 20:27:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:27:11 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] GroupSnapshot b61569f6-792c-4f53-a10e-a0badb483a22: creating.
Sep 30 20:27:11 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:11 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Group snapshot b61569f6-792c-4f53-a10e-a0badb483a22: creating. {{(pid=79893) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 30 20:27:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:11 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:11 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Creating offline snapshot 4e40be65-6c86-4ba1-bd50-74e86e466e0d of volume 869e7fe6-f98f-42d6-bd75-498ecd566fae {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[3028a718-d46a-4da8-a585-351e701f08ce]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:12 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=118, name=volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d 1G" returned: 0 in 0.083s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img rebase -u -b volume-869e7fe6-f98f-42d6-bd75-498ecd566fae -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img rebase -u -b volume-869e7fe6-f98f-42d6-bd75-498ecd566fae -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d" returned: 0 in 0.035s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.info" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.info" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.361s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:12 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-76bf5acb-7bcb-4799-88d4-ea6a13164ba5 tempest-GroupSnapshotsTest-2043077670 None] group_snapshot b61569f6-792c-4f53-a10e-a0badb483a22: created successfully
Sep 30 20:27:13 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] group_snapshot b61569f6-792c-4f53-a10e-a0badb483a22: deleting
Sep 30 20:27:13 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] group_snapshot b61569f6-792c-4f53-a10e-a0badb483a22: deleting {{(pid=79893) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-869e7fe6-f98f-42d6-bd75-498ecd566fae" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-869e7fe6-f98f-42d6-bd75-498ecd566fae" acquired by "delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-4e40be65-6c86-4ba1-bd50-74e86e466e0d" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-4e40be65-6c86-4ba1-bd50-74e86e466e0d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Deleting offline snapshot 4e40be65-6c86-4ba1-bd50-74e86e466e0d of volume 869e7fe6-f98f-42d6-bd75-498ecd566fae {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] snapshot_file for this snap is: volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[818b91ad-c268-4c48-ba63-9ca35f48a747]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d" returned: 0 in 0.138s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-869e7fe6-f98f-42d6-bd75-498ecd566fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a56d6-e0fc-4cde-9391-ce5f6e0c5eac]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae" returned: 0 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:13 devstack quobyte-client[79699]: System call "open" of process 93445 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d" returned: 0 in 0.057s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae.4e40be65-6c86-4ba1-bd50-74e86e466e0d" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-4e40be65-6c86-4ba1-bd50-74e86e466e0d" released by "_delete_snapshot" :: held 0.408s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-869e7fe6-f98f-42d6-bd75-498ecd566fae" released by "delete_snapshot" :: held 0.423s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:13 devstack cinder-volume[79893]: WARNING cinder.quota [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1807030079 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1807030079, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:27:13 devstack cinder-volume[79893]: WARNING cinder.quota [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1807030079 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1807030079, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:27:13 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['a07ee4b1-1bed-4f28-904c-785e22d05cf5', '732d1c95-87ec-4445-b460-c3cc06e0cc2f', '285289b9-c25f-4133-b46d-5c4649dfdb65', '53b12956-368d-4421-b717-accc7c68b441'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:13 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-29e6d9b5-9c82-44d2-afa1-97ebc201db60 tempest-GroupSnapshotsTest-2043077670 None] group_snapshot b61569f6-792c-4f53-a10e-a0badb483a22: deleted successfully
Sep 30 20:27:14 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "cinder-quobyte-869e7fe6-f98f-42d6-bd75-498ecd566fae" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-869e7fe6-f98f-42d6-bd75-498ecd566fae" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b658f1-3bb1-461a-b4a5-2478b67b1c58]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-869e7fe6-f98f-42d6-bd75-498ecd566fae" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Lock "cinder-quobyte-869e7fe6-f98f-42d6-bd75-498ecd566fae" released by "delete_volume" :: held 0.185s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['fa9f2566-6662-4f0f-a6e0-7f47e722bc73'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:14 devstack cinder-volume[79893]: WARNING cinder.quota [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1807030079 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1807030079, it is now deprecated. Please use the default quota class for default quota.
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Created reservations ['519861bf-1b7b-43c2-9dd3-2c6453165865', '265344b6-1c2f-487f-8b35-10bed6bd56f7', 'd93f0a00-ad5a-4d0a-a62d-a67273596ae5', 'c148e21c-cc57-4097-abc6-6c12d1ba6ca5'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:14 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:27:14 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-11f7eba2-6077-4468-9541-f2b80c4422fc tempest-GroupSnapshotsTest-2043077670 None] Delete group completed successfully.
Sep 30 20:27:18 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Flow 'volume_create_manager' (527aa179-02d0-415d-ba9a-cf54e7953d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c17f9a-c89a-44e8-97d0-5a7d3bce3e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c17f9a-c89a-44e8-97d0-5a7d3bce3e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1842624720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26138f4a-a561-4dc2-97fa-3da54b73a3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ce3a27ab54447987748e5e9655525b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:19Z,use_quota=True,user_id='2521bf06a4a2432eb1074f1a24ba6c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cdd6bb-4f8d-4442-8b83-1f1680c2a6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cdd6bb-4f8d-4442-8b83-1f1680c2a6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a9c75d-78ec-4a41-9d41-28538b72321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6a9c75d-78ec-4a41-9d41-28538b72321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26138f4a-a561-4dc2-97fa-3da54b73a3b2', 'volume_name': 'volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57f3531-d3ce-4166-8049-5af183d0ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57f3531-d3ce-4166-8049-5af183d0ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c98b0ea-0549-4411-b9dd-77575324c6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:18 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2', 'volume_size': 1}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1842624720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26138f4a-a561-4dc2-97fa-3da54b73a3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ce3a27ab54447987748e5e9655525b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:19Z,use_quota=True,user_id='2521bf06a4a2432eb1074f1a24ba6c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Creating volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:27:18 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:18 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=120, name=volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 1073741824" returned: 0 in 0.100s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] <== create_volume: return (123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.125s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c98b0ea-0549-4411-b9dd-77575324c6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8f36e5-9c67-4024-a5d2-92c7a47b1c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:18 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Volume volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 (26138f4a-a561-4dc2-97fa-3da54b73a3b2): created successfully
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8f36e5-9c67-4024-a5d2-92c7a47b1c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:18 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Flow 'volume_create_manager' (527aa179-02d0-415d-ba9a-cf54e7953d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:18 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-28304308-01f8-4a97-b8f7-ed91ee1a62e1 tempest-SnapshotsActionsTest-9296654 None] Created volume successfully.
Sep 30 20:27:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:27:19 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Creating offline snapshot 8413c17d-66eb-451a-a3ba-b4742c89fd0b of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:27:19 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c993acba-e96b-4888-a8df-1bb0aea2a25b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:19 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=121, name=volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b 1G" returned: 0 in 0.085s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.info" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.info" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.354s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ae2eb3ae-d96d-4a70-8461-bd32e4b72bfc tempest-SnapshotsActionsTest-9296654 None] Create snapshot completed successfully
Sep 30 20:27:21 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Creating offline snapshot 15e851b4-efe6-4f99-b285-0a35eb52b281 of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc30a56-f65b-4c43-9287-c841a36b7a74]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.135s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:21 devstack quobyte-client[79699]: System call "create" of process 93481 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:21 devstack quobyte-client[79699]: System call "getattr" of process 93481 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:21 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=123, name=volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 1G" returned: 0 in 0.095s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.355s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:21 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-e12e0c87-dab3-4dcb-947f-b79ad798a8ca tempest-SnapshotsActionsTest-9296654 None] Create snapshot completed successfully
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-15e851b4-efe6-4f99-b285-0a35eb52b281-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-15e851b4-efe6-4f99-b285-0a35eb52b281-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" acquired by "delete_snapshot" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-quobyte-15e851b4-efe6-4f99-b285-0a35eb52b281" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-15e851b4-efe6-4f99-b285-0a35eb52b281" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Deleting offline snapshot 15e851b4-efe6-4f99-b285-0a35eb52b281 of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] snapshot_file for this snap is: volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d04e4-0ba6-484b-a3c7-bf7f5d96ad83]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b7ef41-2b74-4938-a852-fe08f0a978d6]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281" returned: 0 in 0.073s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.15e851b4-efe6-4f99-b285-0a35eb52b281" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-15e851b4-efe6-4f99-b285-0a35eb52b281" released by "_delete_snapshot" :: held 0.389s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" released by "delete_snapshot" :: held 0.404s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=130,cinder:INSERT=25,cinder:UPDATE=128,cinder:DELETE=5 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Created reservations ['09a4c0e6-ceb3-4ca8-8261-188ead3ff42b', '2e06630f-e47e-4d36-be78-3a4245169848', '42cd4bbc-6eeb-456c-9aa3-4c9d59b99ca9', 'c08d0549-b145-4764-b11e-f12ada934b19'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:22 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Delete snapshot completed successfully.
Sep 30 20:27:22 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6b125a38-7575-469c-be0a-b51d366d7e66 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-15e851b4-efe6-4f99-b285-0a35eb52b281-delete_snapshot" released by "delete_snapshot" :: held 0.494s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:23 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Creating offline snapshot 3a89df37-442c-4a4c-a908-36bd1df0dcd4 of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aea9cb-c914-4e0c-ba9b-d4042039e563]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:23 devstack quobyte-client[79699]: System call "lookup" of process 93502 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:23 devstack quobyte-client[79699]: System call "getattr" of process 93502 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:23 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=124, name=volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 1G" returned: 0 in 0.102s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.356s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:23 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1db21c45-ad38-4bbf-af21-e053c5f6fd52 tempest-SnapshotsActionsTest-9296654 None] Create snapshot completed successfully
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-3a89df37-442c-4a4c-a908-36bd1df0dcd4-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-3a89df37-442c-4a4c-a908-36bd1df0dcd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" acquired by "delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-quobyte-3a89df37-442c-4a4c-a908-36bd1df0dcd4" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-3a89df37-442c-4a4c-a908-36bd1df0dcd4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Deleting offline snapshot 3a89df37-442c-4a4c-a908-36bd1df0dcd4 of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] snapshot_file for this snap is: volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae40350f-617e-49c3-a745-4edf69e2af69]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4" returned: 0 in 0.117s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adff31a-add9-45e9-a0a6-809f3a0b75a6]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.116s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:24 devstack quobyte-client[79699]: System call "getattr" of process 93516 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:24 devstack quobyte-client[79699]: System call "open" of process 93516 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4" returned: 0 in 0.070s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.3a89df37-442c-4a4c-a908-36bd1df0dcd4" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-3a89df37-442c-4a4c-a908-36bd1df0dcd4" released by "_delete_snapshot" :: held 0.370s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" released by "delete_snapshot" :: held 0.385s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Created reservations ['ab57ae1c-c164-4000-9bbe-ee68a6b576da', '0b8af381-a802-488d-b659-67d11f3f0fa4', '5ea20d41-958b-469a-b0df-7fc6b5ed7790', '77c181bf-68bf-403b-ace7-cff76653f6b3'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Delete snapshot completed successfully.
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d2045055-1b03-4365-9dbf-65b2448f1cf0 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-3a89df37-442c-4a4c-a908-36bd1df0dcd4-delete_snapshot" released by "delete_snapshot" :: held 0.458s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Creating offline snapshot 4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef84645-8f1f-485f-b9cf-a1b9538b3eb0]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:26 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=125, name=volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 1G" returned: 0 in 0.099s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.346s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:26 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-19c33247-3123-41b7-8f1a-c2a599763867 tempest-SnapshotsActionsTest-9296654 None] Create snapshot completed successfully
Sep 30 20:27:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:27 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" acquired by "delete_snapshot" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-quobyte-4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Deleting offline snapshot 4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] snapshot_file for this snap is: volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f185374b-4ec9-45b2-88e7-f4a6ede25a7c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" returned: 0 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6f46c5-f690-4e3f-b51d-da99fa2a2da7]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.119s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:27 devstack quobyte-client[79699]: System call "getattr" of process 93538 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" returned: 0 in 0.069s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24" released by "_delete_snapshot" :: held 0.377s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" released by "delete_snapshot" :: held 0.390s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Created reservations ['f60c37f3-3245-4e49-aab7-4a07a252b74b', 'aa2e97c1-73c8-4193-a791-0be26c2d6f58', 'b3ebde95-ae77-4a12-a80c-73b40e46b349', '7ae4f4ca-286c-456b-92d5-3c8077f9d4b2'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:27 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Delete snapshot completed successfully.
Sep 30 20:27:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-69bdb012-0a7c-4540-ac96-9de85c8fbf17 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-4be2d1d4-d3e4-47bb-86b0-fbcde1ca1b24-delete_snapshot" released by "delete_snapshot" :: held 0.464s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Creating offline snapshot ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc29a5bc-81a4-4286-aa9c-eae6388646fc]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.135s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:28 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=126, name=volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 1G" returned: 0 in 0.115s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img rebase -u -b volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.371s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1f51d51e-d087-4908-9029-5c48512ff50e tempest-SnapshotsActionsTest-9296654 None] Create snapshot completed successfully
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" acquired by "delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Acquiring lock "cinder-quobyte-ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Deleting offline snapshot ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] snapshot_file for this snap is: volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c4d913-55ab-424f-9a41-e1da821d3cdf]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" returned: 0 in 0.134s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[324fc7e2-2c28-4615-b59f-328c150de3e3]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.134s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:29 devstack quobyte-client[79699]: System call "getlk" of process 93559 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" returned: 0 in 0.074s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15" released by "_delete_snapshot" :: held 0.415s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" released by "delete_snapshot" :: held 0.429s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Created reservations ['35dfda1b-2293-499a-90f8-f6e5eb98fc6a', '6d4edf23-7487-442d-bad6-23b73a3f2387', '9173c8bb-b89b-4c27-bcb6-0fb1d316f78a', '7b091a88-4ad0-4f53-ab93-5902b9e6e896'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Delete snapshot completed successfully.
Sep 30 20:27:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df80a123-e7ee-4f39-a87d-bb86e787c837 tempest-SnapshotsActionsTest-1513470693 None] Lock "cinder-ee58db9b-dc6e-43aa-b2ea-b7f27ed86a15-delete_snapshot" released by "delete_snapshot" :: held 0.509s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "cinder-8413c17d-66eb-451a-a3ba-b4742c89fd0b-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-8413c17d-66eb-451a-a3ba-b4742c89fd0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "cinder-quobyte-8413c17d-66eb-451a-a3ba-b4742c89fd0b" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-quobyte-8413c17d-66eb-451a-a3ba-b4742c89fd0b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Deleting offline snapshot 8413c17d-66eb-451a-a3ba-b4742c89fd0b of volume 26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] snapshot_file for this snap is: volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8480431a-a285-4d8e-a53c-7671af84c0df]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.141s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f756dbdd-345e-42d9-ab83-b882b4f37330]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:31 devstack quobyte-client[79699]: System call "getattr" of process 93570 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.059s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2.8413c17d-66eb-451a-a3ba-b4742c89fd0b" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-quobyte-8413c17d-66eb-451a-a3ba-b4742c89fd0b" released by "_delete_snapshot" :: held 0.401s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" released by "delete_snapshot" :: held 0.414s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Created reservations ['7f77ba07-cc00-4f58-b37c-3b94443bb562', '295c6c62-faa7-461f-a0c2-cc3324959b89', 'd68c0816-35fc-402f-984b-4a9041968340', '3d0e8f89-cfac-4379-bdc7-b7703f6a6967'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:31 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Delete snapshot completed successfully.
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f3ab5f58-be6f-46f5-9bc6-0ac52b15190c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-8413c17d-66eb-451a-a3ba-b4742c89fd0b-delete_snapshot" released by "delete_snapshot" :: held 0.498s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "cinder-26138f4a-a561-4dc2-97fa-3da54b73a3b2-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-26138f4a-a561-4dc2-97fa-3da54b73a3b2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:31 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" acquired by "delete_volume" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a424bbb4-0d39-4107-99d8-c315f91b8022]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-26138f4a-a561-4dc2-97fa-3da54b73a3b2" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-quobyte-26138f4a-a561-4dc2-97fa-3da54b73a3b2" released by "delete_volume" :: held 0.179s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Created reservations ['ace052ab-c532-4b79-a6a8-89cf84f2e87c', '8953fbd3-7780-4b6a-8b82-6e156142df57', '42c48ac9-be55-4398-803e-8bf60b301fd9', '6c7765f4-3224-4dbe-a11f-ca13b022b438'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:27:32 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Deleted volume successfully.
Sep 30 20:27:32 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d235b36c-8c71-46ee-a95f-2a07d3726a5c tempest-SnapshotsActionsTest-9296654 None] Lock "cinder-26138f4a-a561-4dc2-97fa-3da54b73a3b2-delete_volume" released by "delete_volume" :: held 0.330s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=162,cinder:UPDATE=167,cinder:INSERT=37,cinder:DELETE=8 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:27:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Flow 'volume_create_manager' (a65c043f-783c-40de-9f08-37d71ce1a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c207f0-b5a4-45aa-a541-4153505e7843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c207f0-b5a4-45aa-a541-4153505e7843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706836477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acf03ea-4422-499d-8038-b01f324ee7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ec9b8296f4210b2f3ec2f11e24d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:40Z,use_quota=True,user_id='dd88255d3f514ae7a5cbb5cd2b021591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e7976a-e091-4186-95d9-e38d54699010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e7976a-e091-4186-95d9-e38d54699010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2f3bb7-4ee9-451c-9015-a0ca863b144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2f3bb7-4ee9-451c-9015-a0ca863b144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2acf03ea-4422-499d-8038-b01f324ee7fd', 'volume_name': 'volume-2acf03ea-4422-499d-8038-b01f324ee7fd', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a0db4c-74af-4761-80ac-f839739bab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a0db4c-74af-4761-80ac-f839739bab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa417d00-ed51-4ab4-a82a-60f1d3f9b82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:40 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume 2acf03ea-4422-499d-8038-b01f324ee7fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2acf03ea-4422-499d-8038-b01f324ee7fd', 'volume_size': 1}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706836477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2acf03ea-4422-499d-8038-b01f324ee7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ec9b8296f4210b2f3ec2f11e24d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:40Z,use_quota=True,user_id='dd88255d3f514ae7a5cbb5cd2b021591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Creating volume 2acf03ea-4422-499d-8038-b01f324ee7fd {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:27:40 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2acf03ea-4422-499d-8038-b01f324ee7fd 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:40 devstack quobyte-client[79699]: System call "ioctl" of process 93583 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:40 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=127, name=volume-2acf03ea-4422-499d-8038-b01f324ee7fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2acf03ea-4422-499d-8038-b01f324ee7fd 1073741824" returned: 0 in 0.103s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2acf03ea-4422-499d-8038-b01f324ee7fd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2acf03ea-4422-499d-8038-b01f324ee7fd" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] <== create_volume: return (128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.130s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa417d00-ed51-4ab4-a82a-60f1d3f9b82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2acf03ea-4422-499d-8038-b01f324ee7fd', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5361fb92-2fc8-4529-8f04-d201b5670e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:40 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume volume-2acf03ea-4422-499d-8038-b01f324ee7fd (2acf03ea-4422-499d-8038-b01f324ee7fd): created successfully
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5361fb92-2fc8-4529-8f04-d201b5670e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Flow 'volume_create_manager' (a65c043f-783c-40de-9f08-37d71ce1a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:40 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-073e501c-a4f6-4b0e-96d7-316b9b9682f7 tempest-VolumeQuotasAdminTestJSON-421312759 None] Created volume successfully.
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Acquiring lock "cinder-2acf03ea-4422-499d-8038-b01f324ee7fd-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "cinder-2acf03ea-4422-499d-8038-b01f324ee7fd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:41 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Acquiring lock "cinder-quobyte-2acf03ea-4422-499d-8038-b01f324ee7fd" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "cinder-quobyte-2acf03ea-4422-499d-8038-b01f324ee7fd" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2cb658-066a-4872-9e84-7e1bd8f87e02]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2acf03ea-4422-499d-8038-b01f324ee7fd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2acf03ea-4422-499d-8038-b01f324ee7fd" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2acf03ea-4422-499d-8038-b01f324ee7fd {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2acf03ea-4422-499d-8038-b01f324ee7fd" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "cinder-quobyte-2acf03ea-4422-499d-8038-b01f324ee7fd" released by "delete_volume" :: held 0.167s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Created reservations ['abd65bc8-87eb-4e1e-94e4-0c499a821e6a', '8b7f5d91-22aa-4529-b723-f4a9b31baa72', 'dfbf815b-d921-4d06-993c-9e3f08db462e', 'c89d849c-1f85-4e5b-9550-88fb48c7dafb'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:27:41 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Deleted volume successfully.
Sep 30 20:27:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7423502f-8e2a-4e2a-80d5-21f7c67602fc tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "cinder-2acf03ea-4422-499d-8038-b01f324ee7fd-delete_volume" released by "delete_volume" :: held 0.302s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:27:42 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Flow 'volume_create_manager' (f6c04e5b-5cd5-469f-b9dd-aed8a2498723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200ea6c5-3f47-4cee-992d-8aa7deeedf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200ea6c5-3f47-4cee-992d-8aa7deeedf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1496647245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0a9928-da78-4937-8b49-294c66dd8459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ec9b8296f4210b2f3ec2f11e24d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:42Z,use_quota=True,user_id='dd88255d3f514ae7a5cbb5cd2b021591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24014215-16eb-40eb-b420-7174a676e535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24014215-16eb-40eb-b420-7174a676e535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03294f85-87ba-4fe7-9ba8-ad5279e0c09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03294f85-87ba-4fe7-9ba8-ad5279e0c09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0a9928-da78-4937-8b49-294c66dd8459', 'volume_name': 'volume-9e0a9928-da78-4937-8b49-294c66dd8459', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01dda52-4cd3-4462-8a6a-dafb9ae467eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d01dda52-4cd3-4462-8a6a-dafb9ae467eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878e5783-555b-446c-936c-6d77e4f780ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:42 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume 9e0a9928-da78-4937-8b49-294c66dd8459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0a9928-da78-4937-8b49-294c66dd8459', 'volume_size': 1}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1496647245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0a9928-da78-4937-8b49-294c66dd8459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f0ec9b8296f4210b2f3ec2f11e24d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:42Z,use_quota=True,user_id='dd88255d3f514ae7a5cbb5cd2b021591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Creating volume 9e0a9928-da78-4937-8b49-294c66dd8459 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:27:42 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9e0a9928-da78-4937-8b49-294c66dd8459 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:42 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=128, name=volume-9e0a9928-da78-4937-8b49-294c66dd8459, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9e0a9928-da78-4937-8b49-294c66dd8459 1073741824" returned: 0 in 0.102s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9e0a9928-da78-4937-8b49-294c66dd8459 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9e0a9928-da78-4937-8b49-294c66dd8459" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] <== create_volume: return (124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.125s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878e5783-555b-446c-936c-6d77e4f780ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0a9928-da78-4937-8b49-294c66dd8459', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e6e455-ffa7-433f-98b8-02e23b24fc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:42 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Volume volume-9e0a9928-da78-4937-8b49-294c66dd8459 (9e0a9928-da78-4937-8b49-294c66dd8459): created successfully
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e6e455-ffa7-433f-98b8-02e23b24fc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Flow 'volume_create_manager' (f6c04e5b-5cd5-469f-b9dd-aed8a2498723) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a5a26a06-eb5e-4caa-8803-4ed490e48877 tempest-VolumeQuotasAdminTestJSON-421312759 None] Created volume successfully.
Sep 30 20:27:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7461096e-c346-4c94-8ceb-ab1089550d87 tempest-VolumeQuotasAdminTestJSON-1486620285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7461096e-c346-4c94-8ceb-ab1089550d87 tempest-VolumeQuotasAdminTestJSON-1486620285 None] Transfer volume completed successfully.
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Acquiring lock "cinder-9e0a9928-da78-4937-8b49-294c66dd8459-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Lock "cinder-9e0a9928-da78-4937-8b49-294c66dd8459-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:44 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Acquiring lock "cinder-quobyte-9e0a9928-da78-4937-8b49-294c66dd8459" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Lock "cinder-quobyte-9e0a9928-da78-4937-8b49-294c66dd8459" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[615ba5bb-d2e4-458d-abf4-f8365525d3ab]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9e0a9928-da78-4937-8b49-294c66dd8459 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9e0a9928-da78-4937-8b49-294c66dd8459" returned: 0 in 0.131s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9e0a9928-da78-4937-8b49-294c66dd8459 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9e0a9928-da78-4937-8b49-294c66dd8459" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Lock "cinder-quobyte-9e0a9928-da78-4937-8b49-294c66dd8459" released by "delete_volume" :: held 0.171s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Created reservations ['2411c536-78e7-4fb7-967f-61d36d761075', '6de022aa-3a09-4c34-9a56-4bebf05dea75', 'db802d00-0c21-4c02-b91f-bd9fb5e48133', 'd8ff16c2-2001-43a3-ba16-cac396e98a1b'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:27:44 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Deleted volume successfully.
Sep 30 20:27:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7039db6d-4f6e-4fca-ba61-9b6bde4f37d6 tempest-VolumeQuotasAdminTestJSON-492870552 None] Lock "cinder-9e0a9928-da78-4937-8b49-294c66dd8459-delete_volume" released by "delete_volume" :: held 0.307s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:27:49 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Flow 'volume_create_manager' (c2340695-3522-48ed-9179-21aeb992ff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb92c5eb-ee11-4202-91a2-fd3706c51e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb92c5eb-ee11-4202-91a2-fd3706c51e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1960806979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2602e813-fb52-4a60-ba03-4055a6a501a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903d873a51c14a7f827a465ee455331f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:50Z,use_quota=True,user_id='2d999351a16f4d3ca176c1b30f56aba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b66baa4-4ed4-4001-939a-a50b062af4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b66baa4-4ed4-4001-939a-a50b062af4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dab72b2-1c05-4dcb-8845-25d40aae9a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dab72b2-1c05-4dcb-8845-25d40aae9a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2602e813-fb52-4a60-ba03-4055a6a501a3', 'volume_name': 'volume-2602e813-fb52-4a60-ba03-4055a6a501a3', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fbd162-09b8-4aef-ba30-6770547904cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fbd162-09b8-4aef-ba30-6770547904cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9993a852-817d-4fbe-a42e-abaf285df377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:49 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Volume 2602e813-fb52-4a60-ba03-4055a6a501a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2602e813-fb52-4a60-ba03-4055a6a501a3', 'volume_size': 1}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1960806979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2602e813-fb52-4a60-ba03-4055a6a501a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903d873a51c14a7f827a465ee455331f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:50Z,use_quota=True,user_id='2d999351a16f4d3ca176c1b30f56aba4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Creating volume 2602e813-fb52-4a60-ba03-4055a6a501a3 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:27:49 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2602e813-fb52-4a60-ba03-4055a6a501a3 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:49 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=129, name=volume-2602e813-fb52-4a60-ba03-4055a6a501a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2602e813-fb52-4a60-ba03-4055a6a501a3 1073741824" returned: 0 in 0.108s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2602e813-fb52-4a60-ba03-4055a6a501a3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2602e813-fb52-4a60-ba03-4055a6a501a3" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] <== create_volume: return (133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.135s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9993a852-817d-4fbe-a42e-abaf285df377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2602e813-fb52-4a60-ba03-4055a6a501a3', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4fd68b-ba9a-48c1-acfd-d4846fed3c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:49 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Volume volume-2602e813-fb52-4a60-ba03-4055a6a501a3 (2602e813-fb52-4a60-ba03-4055a6a501a3): created successfully
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4fd68b-ba9a-48c1-acfd-d4846fed3c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:49 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Flow 'volume_create_manager' (c2340695-3522-48ed-9179-21aeb992ff12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:49 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-643befea-5114-415f-b7ff-3ee21b91d19f tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Created volume successfully.
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Acquiring lock "cinder-2602e813-fb52-4a60-ba03-4055a6a501a3-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "cinder-2602e813-fb52-4a60-ba03-4055a6a501a3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:51 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Acquiring lock "cinder-quobyte-2602e813-fb52-4a60-ba03-4055a6a501a3" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "cinder-quobyte-2602e813-fb52-4a60-ba03-4055a6a501a3" acquired by "delete_volume" :: waited 0.017s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4fa054-91fb-45d7-8800-a550fd21b076]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2602e813-fb52-4a60-ba03-4055a6a501a3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2602e813-fb52-4a60-ba03-4055a6a501a3" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2602e813-fb52-4a60-ba03-4055a6a501a3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2602e813-fb52-4a60-ba03-4055a6a501a3" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "cinder-quobyte-2602e813-fb52-4a60-ba03-4055a6a501a3" released by "delete_volume" :: held 0.165s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Created reservations ['5eac3a6c-a00c-4826-b3ef-07ad2cf93890', '8d7bafec-1fd0-4b9c-b1f7-3d2cfc1bdeb9', 'dc3ddfdc-6d85-420d-91fe-ff748254655f', 'af0f9ec3-0cfa-45c4-8446-392bc63b09b1'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:27:51 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Deleted volume successfully.
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d9c0992c-24e6-479b-b480-d4f2dcd2ee6b tempest-VolumeQuotasNegativeTestJSON-1705893861 None] Lock "cinder-2602e813-fb52-4a60-ba03-4055a6a501a3-delete_volume" released by "delete_volume" :: held 0.315s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:27:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:27:57 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:27:57 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:27:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Flow 'volume_create_manager' (e7635205-1874-48aa-a6fc-9f6ed03b7321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:27:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4271f03-d935-4193-8abe-c03a7356ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4271f03-d935-4193-8abe-c03a7356ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-648591714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33353cc-2226-4f31-9758-8d2c1ae82504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4bdc164a1b4aa48d5b3a2276119a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:58Z,use_quota=True,user_id='b93c1d109f73421dbf7293876a49598a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53ec392-1780-4190-b094-f27ea5fbb58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53ec392-1780-4190-b094-f27ea5fbb58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:57 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdf313d-a4a7-4480-af62-ad1c63ba8f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:57 devstack cinder-volume[79893]: DEBUG cinder.image.glance [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Creating Keystone auth plugin from conf {{(pid=79893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdf313d-a4a7-4480-af62-ad1c63ba8f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd33353cc-2226-4f31-9758-8d2c1ae82504', 'volume_name': 'volume-d33353cc-2226-4f31-9758-8d2c1ae82504', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e0668c0>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9701e4-33af-456a-a3eb-3b94784a7169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9701e4-33af-456a-a3eb-3b94784a7169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240b60cb-a8bd-4d9a-b0d1-1c716d6250cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:27:58 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Volume d33353cc-2226-4f31-9758-8d2c1ae82504: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d33353cc-2226-4f31-9758-8d2c1ae82504', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e0668c0>}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Cloning d33353cc-2226-4f31-9758-8d2c1ae82504 from image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]). {{(pid=79893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 20:27:58 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47c9a1f-972d-41a8-9e75-f7f1803ea220]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:58 devstack sudo[93614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD
Sep 30 20:27:58 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:27:58 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Temporary image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 is fetched for user b93c1d109f73421dbf7293876a49598a. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0e9045-f864-4ddb-bc22-c74391f1936f]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:59 devstack sudo[93619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD
Sep 30 20:27:59 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:27:59 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-648591714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33353cc-2226-4f31-9758-8d2c1ae82504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4bdc164a1b4aa48d5b3a2276119a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:27:58Z,use_quota=True,user_id='b93c1d109f73421dbf7293876a49598a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Creating volume d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:27:59 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:59 devstack quobyte-client[79699]: System call "ioctl" of process 93624 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:27:59 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=130, name=volume-d33353cc-2226-4f31-9758-8d2c1ae82504, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 1073741824" returned: 0 in 0.112s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] <== create_volume: return (137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.140s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Attempting download of d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}])) to volume d33353cc-2226-4f31-9758-8d2c1ae82504. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92fa0e0-caa1-4215-9f88-cb80e4124447]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_4bdpk8cj {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_4bdpk8cj" returned: 0 in 0.110s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_4bdpk8cj {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_4bdpk8cj" returned: 1 in 0.107s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_4bdpk8cj' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68da2c-15d6-430f-a949-8b1b3decfdf8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD" returned: 0 in 0.131s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 was qcow2, converting to raw {{(pid=79893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 20:27:59 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:00 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=130, name=volume-d33353cc-2226-4f31-9758-8d2c1ae82504, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504" returned: 0 in 0.266s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_gszvnvucdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:28:00 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 1G" returned: 0 in 0.041s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c78997-da75-4c34-8acc-240f106f2bb0]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504" returned: 0 in 0.117s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504" returned: 1 in 0.118s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Downloaded image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}])) to volume d33353cc-2226-4f31-9758-8d2c1ae82504 successfully. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Temporary image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 for user b93c1d109f73421dbf7293876a49598a is deleted. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Marking volume d33353cc-2226-4f31-9758-8d2c1ae82504 as bootable. {{(pid=79893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Copying metadata from image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 to d33353cc-2226-4f31-9758-8d2c1ae82504. {{(pid=79893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Creating volume glance metadata for volume d33353cc-2226-4f31-9758-8d2c1ae82504 backed by image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=79893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (240b60cb-a8bd-4d9a-b0d1-1c716d6250cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33353cc-2226-4f31-9758-8d2c1ae82504', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f673e0668c0>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d01259-1874-4716-8744-9fce1754add5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:28:00 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Volume volume-d33353cc-2226-4f31-9758-8d2c1ae82504 (d33353cc-2226-4f31-9758-8d2c1ae82504): created successfully
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d01259-1874-4716-8744-9fce1754add5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:28:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Flow 'volume_create_manager' (e7635205-1874-48aa-a6fc-9f6ed03b7321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:28:00 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d59894fb-2fef-4b91-be9c-870fc8538804 tempest-VolumesImageMetadata-2001047559 None] Created volume successfully.
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Acquiring lock "cinder-d33353cc-2226-4f31-9758-8d2c1ae82504-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Lock "cinder-d33353cc-2226-4f31-9758-8d2c1ae82504-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:28:01 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Acquiring lock "cinder-quobyte-d33353cc-2226-4f31-9758-8d2c1ae82504" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Lock "cinder-quobyte-d33353cc-2226-4f31-9758-8d2c1ae82504" acquired by "delete_volume" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[941990a7-3eff-450b-b556-d9951d4870a9]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504" returned: 0 in 0.117s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504" returned: 1 in 0.117s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d33353cc-2226-4f31-9758-8d2c1ae82504" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Lock "cinder-quobyte-d33353cc-2226-4f31-9758-8d2c1ae82504" released by "delete_volume" :: held 0.303s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Created reservations ['9c24cf7c-a8ee-4625-a618-62674d10a6e2', 'edd8626a-3a17-4a29-9286-97699452f23c', '3d04549e-ca9f-42c9-b9d8-1c1d15f14169', 'd48f6071-2ece-4cd6-9105-1ebcb96ee91b'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:28:01 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Deleted volume successfully.
Sep 30 20:28:01 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-2b5baaec-8e6b-4bc5-a5b1-4f1b2a669a26 tempest-VolumesImageMetadata-2001047559 None] Lock "cinder-d33353cc-2226-4f31-9758-8d2c1ae82504-delete_volume" released by "delete_volume" :: held 0.439s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:28:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:28:08 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Flow 'volume_create_manager' (7d89a857-f36b-4b51-98b4-105b4ee0db47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94953f30-54a4-43b4-af4e-9da48051bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94953f30-54a4-43b4-af4e-9da48051bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2112463790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee8c1e3-f800-4a5c-9dd2-babf07da15c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0527344ea05c42e4b43bbd7a11defc54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:28:09Z,use_quota=True,user_id='fc425b9419724e4cac3ac286bc4697f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd3bb45-ea81-4e7f-86c6-b55ddd42a980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd3bb45-ea81-4e7f-86c6-b55ddd42a980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ecaceb-5a31-4615-a05b-f19f3265e685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ecaceb-5a31-4615-a05b-f19f3265e685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee8c1e3-f800-4a5c-9dd2-babf07da15c4', 'volume_name': 'volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9ace95-62f1-4d5b-b8cd-de0e51cbeda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e9ace95-62f1-4d5b-b8cd-de0e51cbeda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fe33f8-1ee1-436a-ab8d-463b32891a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:28:08 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Volume 6ee8c1e3-f800-4a5c-9dd2-babf07da15c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4', 'volume_size': 1}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2112463790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ee8c1e3-f800-4a5c-9dd2-babf07da15c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0527344ea05c42e4b43bbd7a11defc54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:28:09Z,use_quota=True,user_id='fc425b9419724e4cac3ac286bc4697f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Creating volume 6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:28:08 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:28:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:08 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=131, name=volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:28:08 devstack quobyte-client[79699]: System call "getattr" of process 93700 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 1073741824" returned: 0 in 0.113s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] <== create_volume: return (137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.139s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85fe33f8-1ee1-436a-ab8d-463b32891a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945370dc-53fd-403e-b6bd-9a6ba992908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:28:09 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Volume volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 (6ee8c1e3-f800-4a5c-9dd2-babf07da15c4): created successfully
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945370dc-53fd-403e-b6bd-9a6ba992908e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:28:09 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Flow 'volume_create_manager' (7d89a857-f36b-4b51-98b4-105b4ee0db47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:28:09 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c833c752-4a4a-49c0-abbc-5c2cb014a96a tempest-VolumesActionsTest-488024850 None] Created volume successfully.
Sep 30 20:28:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:28:19 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=46,cinder:DELETE=5,cinder:SELECT=35,cinder:INSERT=11 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:28:19 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:INSERT=32,cinder:UPDATE=74,cinder:SELECT=53,cinder:DELETE=5 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:28:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:28:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-177efb3b-21cd-40cb-968d-5872010190ba tempest-VolumesActionsTest-488024850 None] Acquiring lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" by "attach_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:28:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-177efb3b-21cd-40cb-968d-5872010190ba tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" acquired by "attach_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:28:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-177efb3b-21cd-40cb-968d-5872010190ba tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:24 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-177efb3b-21cd-40cb-968d-5872010190ba tempest-VolumesActionsTest-488024850 None] Attaching volume 6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 to instance 590128ec-0675-4c33-b8bb-bd7dc4a17c61 at mountpoint /dev/vdb on host None.
Sep 30 20:28:24 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-177efb3b-21cd-40cb-968d-5872010190ba tempest-VolumesActionsTest-488024850 None] Attach volume completed successfully.
Sep 30 20:28:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-177efb3b-21cd-40cb-968d-5872010190ba tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" released by "attach_volume" :: held 0.055s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:28:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7be2638a-406f-4ff1-afb2-86601168dd43 tempest-VolumesActionsTest-488024850 None] Acquiring lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-detach_volume" by "detach_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:28:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7be2638a-406f-4ff1-afb2-86601168dd43 tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-detach_volume" acquired by "detach_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:28:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7be2638a-406f-4ff1-afb2-86601168dd43 tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:24 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7be2638a-406f-4ff1-afb2-86601168dd43 tempest-VolumesActionsTest-488024850 None] Detaching volume 6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 from instance 590128ec-0675-4c33-b8bb-bd7dc4a17c61.
Sep 30 20:28:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7be2638a-406f-4ff1-afb2-86601168dd43 tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:24 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7be2638a-406f-4ff1-afb2-86601168dd43 tempest-VolumesActionsTest-488024850 None] Detach volume completed successfully.
Sep 30 20:28:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7be2638a-406f-4ff1-afb2-86601168dd43 tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:28:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:28:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:28:34 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:28:34 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:28:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:28:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7436a3e8-a32c-496c-9dff-674f1f16e093 tempest-VolumesActionsTest-488024850 None] Acquiring lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" by "attach_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:28:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7436a3e8-a32c-496c-9dff-674f1f16e093 tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" acquired by "attach_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:28:46 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-7436a3e8-a32c-496c-9dff-674f1f16e093 tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7436a3e8-a32c-496c-9dff-674f1f16e093 tempest-VolumesActionsTest-488024850 None] Attaching volume 6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 to instance f8276398-9cea-4c71-958f-3993648448ed at mountpoint /dev/vdb on host None.
Sep 30 20:28:46 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-7436a3e8-a32c-496c-9dff-674f1f16e093 tempest-VolumesActionsTest-488024850 None] Attach volume completed successfully.
Sep 30 20:28:46 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-7436a3e8-a32c-496c-9dff-674f1f16e093 tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" released by "attach_volume" :: held 0.070s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:28:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c431b25f-400f-4b84-9f44-f1847364335a tempest-VolumesActionsTest-488024850 None] Acquiring lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-detach_volume" by "detach_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:28:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c431b25f-400f-4b84-9f44-f1847364335a tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:28:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c431b25f-400f-4b84-9f44-f1847364335a tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c431b25f-400f-4b84-9f44-f1847364335a tempest-VolumesActionsTest-488024850 None] Detaching volume 6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 from instance f8276398-9cea-4c71-958f-3993648448ed.
Sep 30 20:28:47 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c431b25f-400f-4b84-9f44-f1847364335a tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:47 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c431b25f-400f-4b84-9f44-f1847364335a tempest-VolumesActionsTest-488024850 None] Detach volume completed successfully.
Sep 30 20:28:47 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c431b25f-400f-4b84-9f44-f1847364335a tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:28:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:28:55 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:28:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:28:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:28:55 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caa7b21-9540-4dd3-b9da-ae605ae8b420]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:28:55 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.143s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:56 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab52327-c54b-4f0f-b79c-aee0f6ce08a5]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:28:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.134s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:56 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.1c49405c-493b-418d-93e4-a2d9b43d5813qaprh0eq.img {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:56 devstack quobyte-client[79699]: System call "getattr" of process 93997 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:28:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:28:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.1c49405c-493b-418d-93e4-a2d9b43d5813qaprh0eq.img" returned: 0 in 1.316s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:57 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[deca62cf-47bd-46e1-bc38-80eec794eafd]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:28:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:28:57 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.245s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:28:57 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4, size 1024.00 MB, duration 1.32 sec, destination /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.1c49405c-493b-418d-93e4-a2d9b43d5813qaprh0eq.img {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:28:57 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Converted 1024.00 MB image at 777.26 MB/s
Sep 30 20:28:57 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] 1c49405c-493b-418d-93e4-a2d9b43d5813 was raw, no need to convert to raw {{(pid=79893) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 30 20:29:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:29:05 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:INSERT=2,cinder:SELECT=7,cinder:UPDATE=5 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:29:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.728s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:06 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Uploaded volume to glance image-id: 1c49405c-493b-418d-93e4-a2d9b43d5813. {{(pid=79893) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 30 20:29:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8fa409d7-d9f5-4f31-b4b4-114ef3448ba7 tempest-VolumesActionsTest-488024850 None] Copy volume to image completed successfully.
Sep 30 20:29:07 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:29:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fd827f-0d2b-41d0-966a-1608cb53f3f5]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a9f79f-3924-44a7-947c-a22e4257c7ca]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img" returned: 0 in 1.439s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7646df47-04a0-46fe-ad27-cffc6aa1913c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.254s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4, size 1024.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:29:09 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Converted 1024.00 MB image at 710.73 MB/s
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] 3b828d53-6562-480b-897c-42fafeadbc69 was raw, converting to qcow2 {{(pid=79893) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfca711e-a901-4d2f-acae-0073e1e6c8d2]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img" returned: 0 in 0.110s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img" returned: 1 in 0.108s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img /opt/stack/data/cinder/conversion/vol_upload_ix7yz3st {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img /opt/stack/data/cinder/conversion/vol_upload_ix7yz3st" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Image conversion details: src /opt/stack/data/cinder/conversion/6ee8c1e3-f800-4a5c-9dd2-babf07da15c4.temp_image.3b828d53-6562-480b-897c-42fafeadbc69wphxbd9x.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ix7yz3st {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:29:10 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[54050d95-f4d2-44d9-ae6e-8d741eb1ad4a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ix7yz3st {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ix7yz3st" returned: 0 in 0.116s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 3.128s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:10 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Uploaded volume to glance image-id: 3b828d53-6562-480b-897c-42fafeadbc69. {{(pid=79893) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 30 20:29:10 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-71e9e85c-5855-4b43-8376-7d234fa3f675 tempest-VolumesActionsTest-488024850 None] Copy volume to image completed successfully.
Sep 30 20:29:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Acquiring lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:29:12 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Acquiring lock "cinder-quobyte-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Lock "cinder-quobyte-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e004838-4a01-4f9a-ad91-1228f8d3ee0d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Lock "cinder-quobyte-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4" released by "delete_volume" :: held 0.172s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Created reservations ['b8520cb6-2e77-424f-9194-94ed2d778997', 'ef83772d-5a73-4df4-9d83-7e51a1659f42', '9b22483a-cba0-4eae-8bf5-6836877e3c94', 'cf5e2140-3884-4481-932f-af7bd14f8ceb'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:29:12 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Deleted volume successfully.
Sep 30 20:29:12 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-0e32996c-40b6-4dc6-ab56-27d448227d16 tempest-VolumesActionsTest-488024850 None] Lock "cinder-6ee8c1e3-f800-4a5c-9dd2-babf07da15c4-delete_volume" released by "delete_volume" :: held 0.319s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:29:17 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Flow 'volume_create_manager' (193a1363-a120-44b6-83ff-44f71e9fe224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c3cbe8-7c99-4865-bb0a-49508beef40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c3cbe8-7c99-4865-bb0a-49508beef40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-534398479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31379955-6624-490d-830c-f113fc306131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b49174026e471b8dea51f8ea87cb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:29:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:29:17Z,use_quota=True,user_id='dc75fef0ed7e42589ff54656a30c45ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cbed54-6fb0-47f4-b78e-6a32b0462a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cbed54-6fb0-47f4-b78e-6a32b0462a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc54948-f9b9-4936-be0b-4958a0c2e41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc54948-f9b9-4936-be0b-4958a0c2e41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31379955-6624-490d-830c-f113fc306131', 'volume_name': 'volume-31379955-6624-490d-830c-f113fc306131', 'volume_size': 2}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1340acc9-56de-489b-b9fe-15a64b9aa0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1340acc9-56de-489b-b9fe-15a64b9aa0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9db322c-d24b-4f77-88fb-c7888e080c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:17 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Volume 31379955-6624-490d-830c-f113fc306131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31379955-6624-490d-830c-f113fc306131', 'volume_size': 2}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-534398479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31379955-6624-490d-830c-f113fc306131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b49174026e471b8dea51f8ea87cb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:29:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:29:17Z,use_quota=True,user_id='dc75fef0ed7e42589ff54656a30c45ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Creating volume 31379955-6624-490d-830c-f113fc306131 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:29:17 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 2147483648 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:17 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=132, name=volume-31379955-6624-490d-830c-f113fc306131, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:29:17 devstack quobyte-client[79699]: System call "open" of process 94084 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 2147483648" returned: 0 in 0.133s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] <== create_volume: return (159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.161s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9db322c-d24b-4f77-88fb-c7888e080c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31379955-6624-490d-830c-f113fc306131', 'volume_size': 2}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6746d25-cabb-4824-8bb8-e0fcbb96284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:17 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Volume volume-31379955-6624-490d-830c-f113fc306131 (31379955-6624-490d-830c-f113fc306131): created successfully
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6746d25-cabb-4824-8bb8-e0fcbb96284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:17 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Flow 'volume_create_manager' (193a1363-a120-44b6-83ff-44f71e9fe224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:29:17 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-33c4c34a-9632-47c6-b037-f8631d4263ed tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Created volume successfully.
Sep 30 20:29:18 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Creating offline snapshot 5242e82d-8571-465e-ae3c-caf8f4b17baf of volume 31379955-6624-490d-830c-f113fc306131 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fc9365-f9f1-497f-8c24-6d70884d08da]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:18 devstack quobyte-client[79699]: System call "getattr" of process 94094 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131" returned: 0 in 0.144s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf 2G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:18 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=133, name=volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf 2G" returned: 0 in 0.084s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): qemu-img rebase -u -b volume-31379955-6624-490d-830c-f113fc306131 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "qemu-img rebase -u -b volume-31379955-6624-490d-830c-f113fc306131 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.info" returned: 0 in 0.021s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.info" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:18 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.374s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:18 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ad463605-6839-4d0d-993e-f44bc8e77d4d tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Create snapshot completed successfully
Sep 30 20:29:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "cinder-5242e82d-8571-465e-ae3c-caf8f4b17baf-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-5242e82d-8571-465e-ae3c-caf8f4b17baf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:29:19 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "cinder-quobyte-31379955-6624-490d-830c-f113fc306131" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-quobyte-31379955-6624-490d-830c-f113fc306131" acquired by "delete_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "cinder-quobyte-5242e82d-8571-465e-ae3c-caf8f4b17baf" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-quobyte-5242e82d-8571-465e-ae3c-caf8f4b17baf" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Deleting offline snapshot 5242e82d-8571-465e-ae3c-caf8f4b17baf of volume 31379955-6624-490d-830c-f113fc306131 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] snapshot_file for this snap is: volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec48f202-a6a3-4fb5-8e51-7e49a54f6bb8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf" returned: 0 in 0.117s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31379955-6624-490d-830c-f113fc306131(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fce3e9-2357-4fa7-9c9a-c0737ee61974]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131" returned: 0 in 0.125s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:19 devstack quobyte-client[79699]: System call "getattr" of process 94113 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:19 devstack quobyte-client[79699]: System call "lookup" of process 94113 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:19 devstack quobyte-client[79699]: System call "getattr" of process 94113 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:19 devstack quobyte-client[79699]: System call "open" of process 94113 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf" returned: 0 in 0.062s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131.5242e82d-8571-465e-ae3c-caf8f4b17baf" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-quobyte-5242e82d-8571-465e-ae3c-caf8f4b17baf" released by "_delete_snapshot" :: held 0.374s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-quobyte-31379955-6624-490d-830c-f113fc306131" released by "delete_snapshot" :: held 0.386s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:29:19 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Created reservations ['425a98e9-f991-420e-b4e0-c17e24ee9580', '1224da29-0f7d-4d49-b014-6bbb7b4dc069', 'b2062062-c1d4-4c98-955d-8bd8977018de', 'f0d6a358-4782-464e-b918-7b14907658a6'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:29:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Delete snapshot completed successfully.
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-248b0774-6659-4ff2-9176-2b6fa3a0d991 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-5242e82d-8571-465e-ae3c-caf8f4b17baf-delete_snapshot" released by "delete_snapshot" :: held 0.470s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "cinder-31379955-6624-490d-830c-f113fc306131-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-31379955-6624-490d-830c-f113fc306131-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:29:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "cinder-quobyte-31379955-6624-490d-830c-f113fc306131" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-quobyte-31379955-6624-490d-830c-f113fc306131" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4446ece-34ac-4b61-8d54-9fe3840e8fc8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-31379955-6624-490d-830c-f113fc306131" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-quobyte-31379955-6624-490d-830c-f113fc306131" released by "delete_volume" :: held 0.177s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Created reservations ['20c20ca8-bcd6-42f7-8152-dee4f074da7d', 'a46b1e6d-f2fa-437b-986c-b51084aa99e8', 'abd178ac-21b0-4216-8d08-506c3ac79332', '8e6b2a57-5a8a-4258-8421-671d266b865d'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:20 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:29:20 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Deleted volume successfully.
Sep 30 20:29:21 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-eae7adb7-119e-4299-9177-ad3d925964b6 tempest-VolumesSnapshotNegativeTestJSON-751080583 None] Lock "cinder-31379955-6624-490d-830c-f113fc306131-delete_volume" released by "delete_volume" :: held 0.316s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:29:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:29:30 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=17,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:29:31 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=32,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:29:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:29:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Flow 'volume_create_manager' (372519f4-cd90-4be2-9faf-ad2103cc592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a62baee-4900-4a25-bc8e-612337e0b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a62baee-4900-4a25-bc8e-612337e0b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-388551420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793958d3-b5d9-46b9-8901-70a9896a83d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f49512800745b687958c60cb90442e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:29:34Z,use_quota=True,user_id='650f479297524e54ae580dfe946f4520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6d5c61-c73e-477c-a83f-ac64800cf3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c6d5c61-c73e-477c-a83f-ac64800cf3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9978aa8f-c77b-4858-bc01-8fe4828180b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9978aa8f-c77b-4858-bc01-8fe4828180b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793958d3-b5d9-46b9-8901-70a9896a83d0', 'volume_name': 'volume-793958d3-b5d9-46b9-8901-70a9896a83d0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505460df-2ce4-47d9-9250-c5647be2c850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (505460df-2ce4-47d9-9250-c5647be2c850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e6f8b7-dda0-402e-b68a-6589261901a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume 793958d3-b5d9-46b9-8901-70a9896a83d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793958d3-b5d9-46b9-8901-70a9896a83d0', 'volume_size': 1}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-388551420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793958d3-b5d9-46b9-8901-70a9896a83d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f49512800745b687958c60cb90442e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:29:34Z,use_quota=True,user_id='650f479297524e54ae580dfe946f4520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Creating volume 793958d3-b5d9-46b9-8901-70a9896a83d0 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:29:34 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:34 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=135, name=volume-793958d3-b5d9-46b9-8901-70a9896a83d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:29:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Flow 'volume_create_manager' (f520a0e4-3236-423c-8381-b37b81296b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5906b5-e739-4089-a154-37b71e52ed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b5906b5-e739-4089-a154-37b71e52ed58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2115137344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb1a6dd-ad03-4194-a7aa-541dbcabb742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f49512800745b687958c60cb90442e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:29:35Z,use_quota=True,user_id='650f479297524e54ae580dfe946f4520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b2678-f63b-489a-89a7-b2ba3d589b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3b2678-f63b-489a-89a7-b2ba3d589b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e423993-f218-4850-bf2a-c4caf648fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e423993-f218-4850-bf2a-c4caf648fa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb1a6dd-ad03-4194-a7aa-541dbcabb742', 'volume_name': 'volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73260a12-515f-44a5-98b4-afb6c27490dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73260a12-515f-44a5-98b4-afb6c27490dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5089308b-796a-481f-9f2c-c4b953910b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume 1eb1a6dd-ad03-4194-a7aa-541dbcabb742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742', 'volume_size': 1}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0 1073741824" returned: 0 in 0.197s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] <== create_volume: return (229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.232s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2115137344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb1a6dd-ad03-4194-a7aa-541dbcabb742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f49512800745b687958c60cb90442e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:29:35Z,use_quota=True,user_id='650f479297524e54ae580dfe946f4520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Creating volume 1eb1a6dd-ad03-4194-a7aa-541dbcabb742 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:29:34 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8e6f8b7-dda0-402e-b68a-6589261901a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793958d3-b5d9-46b9-8901-70a9896a83d0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727c231f-3ceb-4a9a-b388-2e25bc1fa111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume volume-793958d3-b5d9-46b9-8901-70a9896a83d0 (793958d3-b5d9-46b9-8901-70a9896a83d0): created successfully
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727c231f-3ceb-4a9a-b388-2e25bc1fa111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Flow 'volume_create_manager' (372519f4-cd90-4be2-9faf-ad2103cc592a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:29:34 devstack quobyte-client[79699]: System call "open" of process 94128 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:34 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-b113943e-f82f-4674-aadf-99e76a095e71 tempest-TestServerVolumeAttachmentScenario-854789037 None] Created volume successfully.
Sep 30 20:29:34 devstack quobyte-client[79699]: System call "ioctl" of process 94128 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:34 devstack quobyte-client[79699]: System call "open" of process 94128 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:34 devstack quobyte-client[79699]: System call "ioctl" of process 94128 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:29:34 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=136, name=volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742 1073741824" returned: 0 in 0.130s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] <== create_volume: return (156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.158s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5089308b-796a-481f-9f2c-c4b953910b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0af5f01-c3c4-4675-98dd-d91682913629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:29:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742 (1eb1a6dd-ad03-4194-a7aa-541dbcabb742): created successfully
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0af5f01-c3c4-4675-98dd-d91682913629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:29:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Flow 'volume_create_manager' (f520a0e4-3236-423c-8381-b37b81296b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:29:34 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-aaeadae0-fa1a-4d4d-b93c-287b2b0eee2b tempest-TestServerVolumeAttachmentScenario-854789037 None] Created volume successfully.
Sep 30 20:29:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:29:44 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:29:44 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:29:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:29:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:29:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:30:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:30:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:30:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-5975efdf-f0aa-4a3e-8462-53f42cc74cf4 req-5fc5f9df-4d90-4822-a39c-8419d5659ff8 tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:30:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-5975efdf-f0aa-4a3e-8462-53f42cc74cf4 req-5fc5f9df-4d90-4822-a39c-8419d5659ff8 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:30:58 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3ad20b-b101-498d-866e-d39c645e089b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:30:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-5975efdf-f0aa-4a3e-8462-53f42cc74cf4 req-5fc5f9df-4d90-4822-a39c-8419d5659ff8 tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:30:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-5975efdf-f0aa-4a3e-8462-53f42cc74cf4 req-5fc5f9df-4d90-4822-a39c-8419d5659ff8 tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0" returned: 0 in 0.140s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:30:58 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-5975efdf-f0aa-4a3e-8462-53f42cc74cf4 req-5fc5f9df-4d90-4822-a39c-8419d5659ff8 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.149s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:30:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-5975efdf-f0aa-4a3e-8462-53f42cc74cf4 req-5fc5f9df-4d90-4822-a39c-8419d5659ff8 tempest-TestServerVolumeAttachmentScenario-854789037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-793958d3-b5d9-46b9-8901-70a9896a83d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8a43638-8256-4ac0-ae63-711f1ff547d8', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:30:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-5975efdf-f0aa-4a3e-8462-53f42cc74cf4 req-5fc5f9df-4d90-4822-a39c-8419d5659ff8 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:30:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-5975efdf-f0aa-4a3e-8462-53f42cc74cf4 req-5fc5f9df-4d90-4822-a39c-8419d5659ff8 tempest-TestServerVolumeAttachmentScenario-854789037 None] attachment_update completed successfully.
Sep 30 20:31:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:31:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-2c981b7f-7df1-4355-89dc-4d6bc90e7445 req-ad425ff9-9c8f-4e6a-a54f-f983f634f215 tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:31:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-2c981b7f-7df1-4355-89dc-4d6bc90e7445 req-ad425ff9-9c8f-4e6a-a54f-f983f634f215 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:31:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4681a737-f85e-4d1a-9458-8d75ee8ed2b2]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:31:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-2c981b7f-7df1-4355-89dc-4d6bc90e7445 req-ad425ff9-9c8f-4e6a-a54f-f983f634f215 tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:31:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-2c981b7f-7df1-4355-89dc-4d6bc90e7445 req-ad425ff9-9c8f-4e6a-a54f-f983f634f215 tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:31:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-2c981b7f-7df1-4355-89dc-4d6bc90e7445 req-ad425ff9-9c8f-4e6a-a54f-f983f634f215 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.137s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:31:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-2c981b7f-7df1-4355-89dc-4d6bc90e7445 req-ad425ff9-9c8f-4e6a-a54f-f983f634f215 tempest-TestServerVolumeAttachmentScenario-854789037 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '615f51b0-1158-4437-b078-8ec5cce756fe', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:31:07 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-2c981b7f-7df1-4355-89dc-4d6bc90e7445 req-ad425ff9-9c8f-4e6a-a54f-f983f634f215 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:31:07 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-2c981b7f-7df1-4355-89dc-4d6bc90e7445 req-ad425ff9-9c8f-4e6a-a54f-f983f634f215 tempest-TestServerVolumeAttachmentScenario-854789037 None] attachment_update completed successfully.
Sep 30 20:31:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:31:17 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:31:17 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:31:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:31:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:31:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-461cbbe5-06e5-43e9-b36d-a4b40bde90d4 req-b2c31115-b892-4647-b4f1-a2034b332e4c tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:31:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-461cbbe5-06e5-43e9-b36d-a4b40bde90d4 req-b2c31115-b892-4647-b4f1-a2034b332e4c tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:31:34 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-461cbbe5-06e5-43e9-b36d-a4b40bde90d4 req-b2c31115-b892-4647-b4f1-a2034b332e4c tempest-TestServerVolumeAttachmentScenario-854789037 None] Terminate volume connection completed successfully.
Sep 30 20:31:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-461cbbe5-06e5-43e9-b36d-a4b40bde90d4 req-b2c31115-b892-4647-b4f1-a2034b332e4c tempest-TestServerVolumeAttachmentScenario-854789037 None] Deleting attachment 615f51b0-1158-4437-b078-8ec5cce756fe. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:31:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:31:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:31:44 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:31:44 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:31:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.015s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:31:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:31:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:31:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-d23dd0ca-284a-4a93-b740-d1dba94fcea7 req-26b9a532-2f07-4d65-b0de-75cdb558ade0 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:31:58 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-d23dd0ca-284a-4a93-b740-d1dba94fcea7 req-26b9a532-2f07-4d65-b0de-75cdb558ade0 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:31:58 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-d23dd0ca-284a-4a93-b740-d1dba94fcea7 req-26b9a532-2f07-4d65-b0de-75cdb558ade0 tempest-TestServerVolumeAttachmentScenario-854789037 None] Terminate volume connection completed successfully.
Sep 30 20:31:58 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-d23dd0ca-284a-4a93-b740-d1dba94fcea7 req-26b9a532-2f07-4d65-b0de-75cdb558ade0 tempest-TestServerVolumeAttachmentScenario-854789037 None] Deleting attachment b8a43638-8256-4ac0-ae63-711f1ff547d8. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:32:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:32:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "cinder-1eb1a6dd-ad03-4194-a7aa-541dbcabb742-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:32:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "cinder-1eb1a6dd-ad03-4194-a7aa-541dbcabb742-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:32:08 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "cinder-quobyte-1eb1a6dd-ad03-4194-a7aa-541dbcabb742" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "cinder-quobyte-1eb1a6dd-ad03-4194-a7aa-541dbcabb742" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a208895-eab1-4e2c-9d72-997eea88fe87]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742" returned: 0 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1eb1a6dd-ad03-4194-a7aa-541dbcabb742" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "cinder-quobyte-1eb1a6dd-ad03-4194-a7aa-541dbcabb742" released by "delete_volume" :: held 0.166s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Created reservations ['d45f5dc2-0418-410e-96fb-ba6066228563', '5a1e2023-b2bd-43ad-b401-92ba5cff25fd', '4582b74d-df11-4d20-bc66-12a1db2e1ea3', '5d704a4b-874b-4f20-8cc3-b4d272fcd59a'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:32:08 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Deleted volume successfully.
Sep 30 20:32:08 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1af3b6e6-d2db-47c5-ba0d-4e7b97ef0e9f tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "cinder-1eb1a6dd-ad03-4194-a7aa-541dbcabb742-delete_volume" released by "delete_volume" :: held 0.300s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "cinder-793958d3-b5d9-46b9-8901-70a9896a83d0-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "cinder-793958d3-b5d9-46b9-8901-70a9896a83d0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:32:09 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "cinder-quobyte-793958d3-b5d9-46b9-8901-70a9896a83d0" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "cinder-quobyte-793958d3-b5d9-46b9-8901-70a9896a83d0" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39a7bd8-fda3-4daf-a033-600a6f998a46]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0" returned: 0 in 0.164s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-793958d3-b5d9-46b9-8901-70a9896a83d0" returned: 0 in 0.043s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "cinder-quobyte-793958d3-b5d9-46b9-8901-70a9896a83d0" released by "delete_volume" :: held 0.232s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Created reservations ['ca3ac7ea-2a72-43c9-9d4b-f81b552484cc', '84edbd4f-5611-45b6-834b-d4acc7b3bd7f', '9766f901-fa85-49c0-a989-50690af38e80', '7f607f0c-feb9-4842-b09a-fd37136508cf'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:32:09 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Deleted volume successfully.
Sep 30 20:32:09 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-276252ec-6417-4413-9feb-c4ed9e5dfb25 tempest-TestServerVolumeAttachmentScenario-854789037 None] Lock "cinder-793958d3-b5d9-46b9-8901-70a9896a83d0-delete_volume" released by "delete_volume" :: held 0.376s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:32:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:32:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:32:19 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=11,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=2 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:32:19 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=11,cinder:UPDATE=11,cinder:INSERT=6,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:32:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:32:33 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Flow 'volume_create_manager' (39f290da-e545-4dac-8cce-0a65e9c16369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0083d7e6-b224-48b9-a8e5-4219ade9503d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0083d7e6-b224-48b9-a8e5-4219ade9503d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1119781942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5134ba44d37f4d36bf20e191cc92880b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:32:34Z,use_quota=True,user_id='1eb993a8f7144fe484a6c779a29aaed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452e130f-7d19-4201-b9ea-161e52211a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (452e130f-7d19-4201-b9ea-161e52211a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1866024c-153c-4caf-af6c-f6db9e3df01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.image.glance [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Creating Keystone auth plugin from conf {{(pid=79893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1866024c-153c-4caf-af6c-f6db9e3df01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5', 'volume_name': 'volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733aefd90>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc0f516-7bc9-4acf-90b3-229275805b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc0f516-7bc9-4acf-90b3-229275805b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45428694-053d-4184-99bb-1f892e30416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:32:33 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Volume cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733aefd90>}
Sep 30 20:32:33 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Cloning cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 from image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]). {{(pid=79893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 30 20:32:34 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 20:32:34 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Image download 20.69 MB at 20.69 MB/s
Sep 30 20:32:34 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30e297e-de92-4035-9ca9-93bcd8b26fae]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:32:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:34 devstack sudo[94962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD
Sep 30 20:32:34 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:32:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:32:34 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root
Sep 30 20:32:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:34 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Temporary image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 is fetched for user 1eb993a8f7144fe484a6c779a29aaed6. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 20:32:34 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[25abeb97-35b8-4862-aada-aa173178f1f8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:32:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:34 devstack sudo[94967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD
Sep 30 20:32:34 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:32:35 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD" returned: 0 in 0.510s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1119781942',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5134ba44d37f4d36bf20e191cc92880b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:32:34Z,use_quota=True,user_id='1eb993a8f7144fe484a6c779a29aaed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Creating volume cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:32:35 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:35 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=137, name=volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 1073741824" returned: 0 in 0.103s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] <== create_volume: return (128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.131s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Attempting download of d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}])) to volume cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f7223-6855-4e8c-bde7-cb1b75b454f8]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_cw3lmndg {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_cw3lmndg" returned: 0 in 0.107s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_cw3lmndg {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_cw3lmndg" returned: 1 in 0.112s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_cw3lmndg' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[788f85bb-d1fe-42b8-8a8b-2cb4993e333f]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD" returned: 0 in 0.106s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 was qcow2, converting to raw {{(pid=79893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:35 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=137, name=volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 0 in 0.273s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d262365a-f7e2-4cb3-9fa7-a3fbe715aff1_eiwotoe9devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:32:35 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Converted 112.00 MB image at 112.00 MB/s
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:35 devstack quobyte-client[79699]: System call "getlk" of process 94997 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:32:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 1G" returned: 0 in 0.037s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e2f0ac-35d6-4b7a-bd3d-a9367602ae14]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 0 in 0.111s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 1 in 0.112s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Downloaded image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}])) to volume cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 successfully. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Temporary image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 for user 1eb993a8f7144fe484a6c779a29aaed6 is deleted. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Marking volume cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 as bootable. {{(pid=79893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Copying metadata from image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 to cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5. {{(pid=79893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Creating volume glance metadata for volume cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 backed by image d262365a-f7e2-4cb3-9fa7-a3fbe715aff1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=79893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45428694-053d-4184-99bb-1f892e30416b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5', 'volume_size': 1, 'image_id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6d9b0b74e6de49be8cc415c7b41d7c97', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd262365a-f7e2-4cb3-9fa7-a3fbe715aff1', 'created_at': datetime.datetime(2025, 9, 30, 17, 58, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 17, 58, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d262365a-f7e2-4cb3-9fa7-a3fbe715aff1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733aefd90>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1ddda0-20ae-4dc1-9369-9a94386bd426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:32:36 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Volume volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 (cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5): created successfully
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1ddda0-20ae-4dc1-9369-9a94386bd426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:32:36 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Flow 'volume_create_manager' (39f290da-e545-4dac-8cce-0a65e9c16369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:32:36 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-247da41b-2e55-43b9-9a90-b78f904503aa tempest-TestShelveInstance-2109248592 None] Created volume successfully.
Sep 30 20:32:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dab166-03b4-4e3b-af8f-e68603336309]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 0 in 0.120s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 1 in 0.132s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.286s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:32:43 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48211ec4-182a-4360-81ca-75e4541ffe7d', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:32:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:32:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-b687012e-8927-4617-b1a0-aa8c62d1705e req-f177d73f-3b46-4d97-90c1-148a87859fee tempest-TestShelveInstance-2109248592 None] attachment_update completed successfully.
Sep 30 20:32:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:32:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:32:53 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=14,cinder:INSERT=7,cinder:UPDATE=5 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:32:53 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=6,cinder:DELETE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:32:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:33:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:33:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:33:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:33:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:33:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:33:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:33:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:33:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:33:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.015s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:33:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:33:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:34:03 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-cf4b8d68-078d-4471-87ad-32a1aa05707f req-b8cd2b24-1ebd-482e-b1fb-c475e0bd7aac tempest-TestShelveInstance-2109248592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:34:03 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-cf4b8d68-078d-4471-87ad-32a1aa05707f req-b8cd2b24-1ebd-482e-b1fb-c475e0bd7aac tempest-TestShelveInstance-2109248592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:34:03 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-cf4b8d68-078d-4471-87ad-32a1aa05707f req-b8cd2b24-1ebd-482e-b1fb-c475e0bd7aac tempest-TestShelveInstance-2109248592 None] Terminate volume connection completed successfully.
Sep 30 20:34:03 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-cf4b8d68-078d-4471-87ad-32a1aa05707f req-b8cd2b24-1ebd-482e-b1fb-c475e0bd7aac tempest-TestShelveInstance-2109248592 None] Deleting attachment 48211ec4-182a-4360-81ca-75e4541ffe7d. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:34:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[793d1349-7455-41fa-b477-b012fad8fcd8]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 0 in 0.116s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 1 in 0.114s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.266s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:34:07 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e', 'name': 'volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd621d005-f2a1-4c85-8e50-0b8326cfb972', 'enforce_multipath': True} {{(pid=79893) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 30 20:34:07 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:34:07 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-426f9876-1a8e-423b-8c28-25f737f2ce9f req-e0ff45b7-78d7-46cf-812a-b1147daab817 tempest-TestShelveInstance-2109248592 None] attachment_update completed successfully.
Sep 30 20:34:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:34:17 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:34:17 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:34:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:34:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:34:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:34:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:34:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:34:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:34:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:35:04 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:UPDATE=1 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:35:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-c631d842-0930-4570-9561-54664912c114 req-daeabfae-1b18-431d-8f36-0f5d6038abfe tempest-TestShelveInstance-2109248592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-c631d842-0930-4570-9561-54664912c114 req-daeabfae-1b18-431d-8f36-0f5d6038abfe tempest-TestShelveInstance-2109248592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-c631d842-0930-4570-9561-54664912c114 req-daeabfae-1b18-431d-8f36-0f5d6038abfe tempest-TestShelveInstance-2109248592 None] Terminate volume connection completed successfully.
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [req-c631d842-0930-4570-9561-54664912c114 req-daeabfae-1b18-431d-8f36-0f5d6038abfe tempest-TestShelveInstance-2109248592 None] Deleting attachment d621d005-f2a1-4c85-8e50-0b8326cfb972. {{(pid=79893) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Acquiring lock "cinder-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Lock "cinder-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Acquiring lock "cinder-quobyte-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Lock "cinder-quobyte-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[77417f7a-f97a-4333-8e1a-3a31e8c6d3cb]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 0 in 0.136s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 1 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Lock "cinder-quobyte-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5" released by "delete_volume" :: held 0.337s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG cinder.quota [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Created reservations ['35991570-7727-4a55-821b-06153a681b51', '8e4af08e-cb7f-4399-bfc2-3cc11bfce5dd', 'b643391e-326d-464c-8d6b-9e550a3f3922', '35c34c52-2cec-4114-bc7b-531bd3340dcc'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG cinder.manager [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:35:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Deleted volume successfully.
Sep 30 20:35:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [req-c631d842-0930-4570-9561-54664912c114 req-408923e3-7303-4f11-a6ba-f8cdc82c2c1f tempest-TestShelveInstance-2109248592 None] Lock "cinder-cf8ea7f8-84ba-4d1e-ba42-b3046ba3cec5-delete_volume" released by "delete_volume" :: held 0.475s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:37 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:37 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:35:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Flow 'volume_create_manager' (7f091127-30fc-41bc-ae7e-f8488e53efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:35:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbb9eda-6326-4fad-9494-d7fc125ef57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbb9eda-6326-4fad-9494-d7fc125ef57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedb72ff-14c9-4d1c-a18f-b37c0a83d694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f28b71f1c548b9b6bf3098209a1517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:35:38Z,use_quota=True,user_id='53e5ef0bcc16472086cd90afd19d3c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d22d28-91de-47e8-963f-a83d7c142b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d22d28-91de-47e8-963f-a83d7c142b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d3e335-b1a2-4b2b-a072-19c164f32f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d3e335-b1a2-4b2b-a072-19c164f32f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eedb72ff-14c9-4d1c-a18f-b37c0a83d694', 'volume_name': 'volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fcdab5-fc90-438c-8c2a-a681936b94d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fcdab5-fc90-438c-8c2a-a681936b94d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8cb0af-696b-4699-8e9b-87c04ab6f5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:38 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Volume eedb72ff-14c9-4d1c-a18f-b37c0a83d694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694', 'volume_size': 1}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedb72ff-14c9-4d1c-a18f-b37c0a83d694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f28b71f1c548b9b6bf3098209a1517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:35:38Z,use_quota=True,user_id='53e5ef0bcc16472086cd90afd19d3c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Creating volume eedb72ff-14c9-4d1c-a18f-b37c0a83d694 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:35:38 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:38 devstack quobyte-client[79699]: System call "getlk" of process 96390 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:35:38 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=138, name=volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694 1073741824" returned: 0 in 0.113s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] <== create_volume: return (138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.141s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8cb0af-696b-4699-8e9b-87c04ab6f5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628bb1dc-8221-4d01-8f5e-cf57c2e22e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:38 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Volume volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694 (eedb72ff-14c9-4d1c-a18f-b37c0a83d694): created successfully
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628bb1dc-8221-4d01-8f5e-cf57c2e22e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:38 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Flow 'volume_create_manager' (7f091127-30fc-41bc-ae7e-f8488e53efef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:35:38 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-45531127-ed2a-4baf-a434-3eeb9ed7b362 tempest-CinderUnicodeTest-1821060988 None] Created volume successfully.
Sep 30 20:35:39 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Flow 'volume_create_manager' (2b9825c6-fc01-4fb6-9452-8d0862261916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1956be41-8907-4efa-9637-eda877d7d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1956be41-8907-4efa-9637-eda877d7d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:35:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1042461716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef672342-501d-4b05-b3ba-f3a3ccc61bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f28b71f1c548b9b6bf3098209a1517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:35:39Z,use_quota=True,user_id='53e5ef0bcc16472086cd90afd19d3c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a59713f-ea1a-4026-8eee-aababef7d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a59713f-ea1a-4026-8eee-aababef7d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045689c3-a1cf-4379-a928-14155de0abc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (045689c3-a1cf-4379-a928-14155de0abc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef672342-501d-4b05-b3ba-f3a3ccc61bba', 'volume_name': 'volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba231f0c-746e-4cd7-832b-a56f049f748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba231f0c-746e-4cd7-832b-a56f049f748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2b1821-c99d-450d-89fa-abf287f2610d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:39 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Volume ef672342-501d-4b05-b3ba-f3a3ccc61bba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba', 'volume_size': 1}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:35:39Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1042461716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef672342-501d-4b05-b3ba-f3a3ccc61bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f28b71f1c548b9b6bf3098209a1517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:35:39Z,use_quota=True,user_id='53e5ef0bcc16472086cd90afd19d3c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Creating volume ef672342-501d-4b05-b3ba-f3a3ccc61bba {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:35:39 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:39 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=139, name=volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba 1073741824" returned: 0 in 0.110s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] <== create_volume: return (135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.137s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f2b1821-c99d-450d-89fa-abf287f2610d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229faf69-4d5a-4837-a4f0-5737f654b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:39 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Volume volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba (ef672342-501d-4b05-b3ba-f3a3ccc61bba): created successfully
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229faf69-4d5a-4837-a4f0-5737f654b983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:35:39 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Flow 'volume_create_manager' (2b9825c6-fc01-4fb6-9452-8d0862261916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:35:39 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a198338a-fbb9-46b3-9dfc-892fb602e622 tempest-CinderUnicodeTest-1821060988 None] Created volume successfully.
Sep 30 20:35:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Creating offline snapshot 23591c14-4a3e-450a-91cc-8dc73061c7a9 of volume ef672342-501d-4b05-b3ba-f3a3ccc61bba {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef15d1eb-ea90-46f3-a4ae-f63b0cfa065d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:40 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=140, name=volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 1G" returned: 0 in 0.091s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] CMD "qemu-img rebase -u -b volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:35:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.info" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.info" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.371s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:41 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-30dc20d6-0cc6-4508-a752-aeedce6be76d tempest-CinderUnicodeTest-1821060988 None] Create snapshot completed successfully
Sep 30 20:35:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "cinder-23591c14-4a3e-450a-91cc-8dc73061c7a9-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-23591c14-4a3e-450a-91cc-8dc73061c7a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:41 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "cinder-quobyte-ef672342-501d-4b05-b3ba-f3a3ccc61bba" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-quobyte-ef672342-501d-4b05-b3ba-f3a3ccc61bba" acquired by "delete_snapshot" :: waited 0.012s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "cinder-quobyte-23591c14-4a3e-450a-91cc-8dc73061c7a9" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-quobyte-23591c14-4a3e-450a-91cc-8dc73061c7a9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Deleting offline snapshot 23591c14-4a3e-450a-91cc-8dc73061c7a9 of volume ef672342-501d-4b05-b3ba-f3a3ccc61bba {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] snapshot_file for this snap is: volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c958fd5-1b0e-4d5a-a34a-d7cc8bbdcf41]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9" returned: 0 in 0.115s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffc044d-edba-44ec-bef2-38f8e0838117]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:35:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba" returned: 0 in 0.124s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:42 devstack quobyte-client[79699]: System call "getattr" of process 96419 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9" returned: 0 in 0.058s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba.23591c14-4a3e-450a-91cc-8dc73061c7a9" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-quobyte-23591c14-4a3e-450a-91cc-8dc73061c7a9" released by "_delete_snapshot" :: held 0.398s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-quobyte-ef672342-501d-4b05-b3ba-f3a3ccc61bba" released by "delete_snapshot" :: held 0.410s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Created reservations ['ec8b2796-2ce3-4abb-9d41-0bc76f9a02e4', '6267afd2-b2b9-406c-90a6-f063b25cf3f2', '41f4e05d-5acf-46a5-8428-2901f4b0ee63', '8d1699c6-a793-46b0-9c8e-4a1d4e569c9a'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:35:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Delete snapshot completed successfully.
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4b4a40a1-dc60-471a-8b2f-d104c89b03a1 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-23591c14-4a3e-450a-91cc-8dc73061c7a9-delete_snapshot" released by "delete_snapshot" :: held 0.498s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "cinder-ef672342-501d-4b05-b3ba-f3a3ccc61bba-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-ef672342-501d-4b05-b3ba-f3a3ccc61bba-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:42 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "cinder-quobyte-ef672342-501d-4b05-b3ba-f3a3ccc61bba" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-quobyte-ef672342-501d-4b05-b3ba-f3a3ccc61bba" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a277902f-f9da-4555-b21d-5f458ddaba11]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:35:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-ef672342-501d-4b05-b3ba-f3a3ccc61bba" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-quobyte-ef672342-501d-4b05-b3ba-f3a3ccc61bba" released by "delete_volume" :: held 0.181s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Created reservations ['6fba40f2-0d0c-4a89-94f6-ef0d6f2dc27b', 'bca46e98-5863-4a2c-8cd7-149188f37a50', '2f23ac5b-fa5a-4c53-a9ea-cdfd05fe8424', '7d423423-7873-4479-ba71-c514a3893536'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:35:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Deleted volume successfully.
Sep 30 20:35:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4687fc86-55c3-4de2-a305-0bd90d4f8b11 tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-ef672342-501d-4b05-b3ba-f3a3ccc61bba-delete_volume" released by "delete_volume" :: held 0.315s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "cinder-eedb72ff-14c9-4d1c-a18f-b37c0a83d694-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-eedb72ff-14c9-4d1c-a18f-b37c0a83d694-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:44 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "cinder-quobyte-eedb72ff-14c9-4d1c-a18f-b37c0a83d694" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-quobyte-eedb72ff-14c9-4d1c-a18f-b37c0a83d694" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4b9e91-e44c-4a96-bfa1-542ba1c40913]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-eedb72ff-14c9-4d1c-a18f-b37c0a83d694" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-quobyte-eedb72ff-14c9-4d1c-a18f-b37c0a83d694" released by "delete_volume" :: held 0.170s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Created reservations ['6ff3176a-d1a1-4256-93c2-f05a1b474f39', '8b0bab7f-fa6e-4d68-af49-83f0f2509712', '280c01d6-330b-4eab-b57f-f9b6acd1544f', 'ffc1df0d-e9ab-42da-ab8f-2cfe3de95d42'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:35:44 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Deleted volume successfully.
Sep 30 20:35:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-f756cc6d-43e0-4116-8381-037ca728218d tempest-CinderUnicodeTest-1821060988 None] Lock "cinder-eedb72ff-14c9-4d1c-a18f-b37c0a83d694-delete_volume" released by "delete_volume" :: held 0.318s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:35:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:35:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:35:54 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=22,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=6 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:35:54 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=26,cinder:INSERT=10,cinder:UPDATE=36,cinder:DELETE=5 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:35:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:35:59 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:35:59 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:35:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Flow 'volume_create_manager' (bbd1389a-a375-4d79-a1c2-eea338a53130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:35:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1dff738-465f-4329-ba89-d7dce3ec3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:35:59 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1dff738-465f-4329-ba89-d7dce3ec3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-62935132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cbdc89-e83e-497b-8d88-9af9464baed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24092aa4d0de450cb1f92bce975a6d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:00Z,use_quota=True,user_id='5b030d1543e34b0da1d68759115ffa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf47e8c-04fc-41e0-a7c5-ae7f148378c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf47e8c-04fc-41e0-a7c5-ae7f148378c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c08614b-9336-4116-9772-7fa08a35f73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c08614b-9336-4116-9772-7fa08a35f73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77cbdc89-e83e-497b-8d88-9af9464baed5', 'volume_name': 'volume-77cbdc89-e83e-497b-8d88-9af9464baed5', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921fee9c-67fb-4506-b1dc-be26d609e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921fee9c-67fb-4506-b1dc-be26d609e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e080b4-4a79-4491-bde8-60e324985ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:00 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Volume 77cbdc89-e83e-497b-8d88-9af9464baed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77cbdc89-e83e-497b-8d88-9af9464baed5', 'volume_size': 1}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-62935132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cbdc89-e83e-497b-8d88-9af9464baed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24092aa4d0de450cb1f92bce975a6d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:00Z,use_quota=True,user_id='5b030d1543e34b0da1d68759115ffa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Creating volume 77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:00 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:00 devstack quobyte-client[79699]: System call "ioctl" of process 96437 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:00 devstack quobyte-client[79699]: System call "open" of process 96437 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:00 devstack quobyte-client[79699]: System call "ioctl" of process 96437 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:00 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=142, name=volume-77cbdc89-e83e-497b-8d88-9af9464baed5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 1073741824" returned: 0 in 0.115s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] <== create_volume: return (140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.143s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e080b4-4a79-4491-bde8-60e324985ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cbdc89-e83e-497b-8d88-9af9464baed5', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b884156-4559-4dd7-ba1b-cec528044c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:00 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Volume volume-77cbdc89-e83e-497b-8d88-9af9464baed5 (77cbdc89-e83e-497b-8d88-9af9464baed5): created successfully
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b884156-4559-4dd7-ba1b-cec528044c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:00 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Flow 'volume_create_manager' (bbd1389a-a375-4d79-a1c2-eea338a53130) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:00 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-bed342ab-1ad9-47f2-92f8-f519de05de32 tempest-SnapshotDependencyTests-1774556567 None] Created volume successfully.
Sep 30 20:36:01 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Creating offline snapshot ac6d53b5-e7b9-43f2-b7d4-9a40cec045df of volume 77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[59491586-6312-4df3-a3cc-d0ea8af7f7e0]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:01 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=143, name=volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df 1G" returned: 0 in 0.093s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): qemu-img rebase -u -b volume-77cbdc89-e83e-497b-8d88-9af9464baed5 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] CMD "qemu-img rebase -u -b volume-77cbdc89-e83e-497b-8d88-9af9464baed5 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.info" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.info" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:01 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.366s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:01 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f49620be-32f4-4079-9bdf-669c9b61618a tempest-SnapshotDependencyTests-1774556567 None] Create snapshot completed successfully
Sep 30 20:36:02 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Flow 'volume_create_manager' (058a7e18-99fe-40bc-932b-00eb4da55dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120f1f98-3fbd-49c3-86d4-973170a4f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120f1f98-3fbd-49c3-86d4-973170a4f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0831ab7a-78ed-4b3c-82cf-d3c516aa13e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24092aa4d0de450cb1f92bce975a6d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac6d53b5-e7b9-43f2-b7d4-9a40cec045df,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:02Z,use_quota=True,user_id='5b030d1543e34b0da1d68759115ffa3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0fdca2-0f75-420e-9b2e-e29849c3b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0fdca2-0f75-420e-9b2e-e29849c3b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aae150-b813-46f4-a6c2-5666351f4a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aae150-b813-46f4-a6c2-5666351f4a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0831ab7a-78ed-4b3c-82cf-d3c516aa13e0', 'volume_name': 'volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0', 'volume_size': 1, 'snapshot_id': 'ac6d53b5-e7b9-43f2-b7d4-9a40cec045df'}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c1e2fc-e4c1-4928-94e5-89430ce9b2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c1e2fc-e4c1-4928-94e5-89430ce9b2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ece051-b3e1-4a32-be20-a738e61c5624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:02 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Volume 0831ab7a-78ed-4b3c-82cf-d3c516aa13e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0', 'volume_size': 1, 'snapshot_id': 'ac6d53b5-e7b9-43f2-b7d4-9a40cec045df'}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-quobyte-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" by "_create_volume_from_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Creating volume 0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 from snapshot ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-quobyte-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" by "_copy_volume_from_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] snapshot: ac6d53b5-e7b9-43f2-b7d4-9a40cec045df, volume: 0831ab7a-78ed-4b3c-82cf-d3c516aa13e0,  {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4384fd-5fd6-4e9e-9978-066f054feb83]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" returned: 0 in 0.118s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77cbdc89-e83e-497b-8d88-9af9464baed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Creating direct copy from snapshot {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d5d8c9-f785-4f18-9e44-95cb02834a15]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:02 devstack quobyte-client[79699]: System call "getattr" of process 96457 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG cinder.utils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 not found in is_blk_device check {{(pid=79893) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 30 20:36:02 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:02 devstack quobyte-client[79699]: System call "getattr" of process 96460 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:02 devstack quobyte-client[79699]: System call "lookup" of process 96460 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:02 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=145, name=volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" returned: 0 in 1.315s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d3e9d-d776-47fa-8084-3d88c4e6a735]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:04 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5" returned: 0 in 0.251s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5, size 1024.00 MB, duration 1.32 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:36:04 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Converted 1024.00 MB image at 777.87 MB/s
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" released by "_copy_volume_from_snapshot" :: held 1.887s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" released by "_create_volume_from_snapshot" :: held 1.904s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.912s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ece051-b3e1-4a32-be20-a738e61c5624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0', 'volume_size': 1, 'snapshot_id': 'ac6d53b5-e7b9-43f2-b7d4-9a40cec045df'}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4862e84-ff59-49c2-a893-13dddc3d2585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:04 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Volume volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 (0831ab7a-78ed-4b3c-82cf-d3c516aa13e0): created successfully
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4862e84-ff59-49c2-a893-13dddc3d2585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Flow 'volume_create_manager' (058a7e18-99fe-40bc-932b-00eb4da55dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:04 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ce1b936c-d49e-434b-8b21-ce13cbb96bbc tempest-SnapshotDependencyTests-1774556567 None] Created volume successfully.
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:04 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-quobyte-77cbdc89-e83e-497b-8d88-9af9464baed5" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-77cbdc89-e83e-497b-8d88-9af9464baed5" acquired by "delete_snapshot" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-quobyte-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Deleting offline snapshot ac6d53b5-e7b9-43f2-b7d4-9a40cec045df of volume 77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] snapshot_file for this snap is: volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[512238f2-1b0b-43cd-add1-ffdd02229b79]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" returned: 0 in 0.133s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77cbdc89-e83e-497b-8d88-9af9464baed5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f0cde4-070a-49a6-a826-a85c098a49e4]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:04 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:05 devstack quobyte-client[79699]: System call "getlk" of process 96480 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" returned: 0 in 0.059s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5.ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df" released by "_delete_snapshot" :: held 0.384s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-77cbdc89-e83e-497b-8d88-9af9464baed5" released by "delete_snapshot" :: held 0.396s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Created reservations ['44b93e2f-c2d9-4066-96a5-74c9ee06ab2e', '9e08216f-98b5-4f43-a413-2fa6a3f89aab', '7c60f988-cb20-49a2-aa9e-ead23a3f6203', 'd78fb052-05b6-4d46-a1bf-3e2ec67ad1a7'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:05 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Delete snapshot completed successfully.
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-86227287-8d74-426d-a018-38176e39434a tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-ac6d53b5-e7b9-43f2-b7d4-9a40cec045df-delete_snapshot" released by "delete_snapshot" :: held 0.475s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-77cbdc89-e83e-497b-8d88-9af9464baed5-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-77cbdc89-e83e-497b-8d88-9af9464baed5-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:05 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-quobyte-77cbdc89-e83e-497b-8d88-9af9464baed5" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-77cbdc89-e83e-497b-8d88-9af9464baed5" acquired by "delete_volume" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[862b9ded-773e-4700-bea5-a5ea13f8767d]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5" returned: 0 in 0.124s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-77cbdc89-e83e-497b-8d88-9af9464baed5" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:05 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-77cbdc89-e83e-497b-8d88-9af9464baed5" released by "delete_volume" :: held 0.177s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Created reservations ['65825c78-a731-4970-a1f6-e0c9f98a3a37', 'cd6f0990-4762-4773-88b8-7a61e480cdd7', '76623a9c-db9f-47fb-b89c-d08698fdb085', 'e5cfd6e6-a664-4228-86e2-79420a85cb6d'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:06 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Deleted volume successfully.
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-19f9a256-cccf-4ebf-a914-80dffbad16b2 tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-77cbdc89-e83e-497b-8d88-9af9464baed5-delete_volume" released by "delete_volume" :: held 0.305s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:06 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "cinder-quobyte-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[558dde3e-b373-419c-a3d8-ec2842c6e291]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:06 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-quobyte-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0" released by "delete_volume" :: held 0.168s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Created reservations ['3acec960-f37f-419f-8f92-df8b58caf125', '61fad5b9-abed-4e74-a725-da3fc8530831', '8bf963d3-5af1-4a5e-8cb5-70c2a7453227', '8717252d-c6fa-45df-bcd1-7e55a3c0ee1d'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:07 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Deleted volume successfully.
Sep 30 20:36:07 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-27541674-1d9b-4654-9d53-eeff425c029d tempest-SnapshotDependencyTests-1774556567 None] Lock "cinder-0831ab7a-78ed-4b3c-82cf-d3c516aa13e0-delete_volume" released by "delete_volume" :: held 0.302s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:11 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:36:17 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=20,cinder:UPDATE=34,cinder:DELETE=3,cinder:INSERT=8 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:36:17 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=19,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=4 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:36:19 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:36:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (f78f19ac-fb90-4449-9dd2-2e0c6df7aa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94eb6452-ef98-4fa5-be0a-a0bedf5d041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94eb6452-ef98-4fa5-be0a-a0bedf5d041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089318456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:21Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81300a9-8c8c-40ab-b3a8-b31cccbf6316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f81300a9-8c8c-40ab-b3a8-b31cccbf6316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8271f5dc-fb53-4431-8099-26bc7c86c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8271f5dc-fb53-4431-8099-26bc7c86c60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3', 'volume_name': 'volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fb3cef-bdfe-46f3-8e3e-10b71c3be029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2fb3cef-bdfe-46f3-8e3e-10b71c3be029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b3dcc0-d5a7-4650-a2a6-d15dc9edff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:20 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3', 'volume_size': 1}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1089318456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:21Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Creating volume cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:20 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:20 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (f3165560-75b2-49d5-ac84-187756f060e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:20 devstack quobyte-client[79699]: System call "getattr" of process 96591 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:20 devstack quobyte-client[79699]: System call "lookup" of process 96591 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:20 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef855886-4330-4692-b442-e10746700f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:20 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=146, name=volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef855886-4330-4692-b442-e10746700f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138092484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bb75c0-cdba-4b04-8077-68a27ce37473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:21Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15ddf2a-ac69-4e18-ab5c-e4d22ef70cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15ddf2a-ac69-4e18-ab5c-e4d22ef70cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec265d7-99a8-4967-b674-9297b3e24350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ec265d7-99a8-4967-b674-9297b3e24350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bb75c0-cdba-4b04-8077-68a27ce37473', 'volume_name': 'volume-97bb75c0-cdba-4b04-8077-68a27ce37473', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe240f9-63f2-445a-bf3e-c4f810c2b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe240f9-63f2-445a-bf3e-c4f810c2b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dd5ee1-c8d6-4a40-a72a-71103ccdef96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Volume 97bb75c0-cdba-4b04-8077-68a27ce37473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bb75c0-cdba-4b04-8077-68a27ce37473', 'volume_size': 1}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3 1073741824" returned: 0 in 0.233s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:21 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (cc2ca718-39e6-4e7e-b9ad-daaf8a27e3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e03c425-dd03-46d4-91ce-13124c14d2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3" returned: 0 in 0.057s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] <== create_volume: return (296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.298s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.069s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1138092484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bb75c0-cdba-4b04-8077-68a27ce37473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:21Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Creating volume 97bb75c0-cdba-4b04-8077-68a27ce37473 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-97bb75c0-cdba-4b04-8077-68a27ce37473 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e03c425-dd03-46d4-91ce-13124c14d2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-608371773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:21Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bb3740-f437-43c3-945e-fa8f0e5ff6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02bb3740-f437-43c3-945e-fa8f0e5ff6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8516a8b-77b8-41cd-a07a-9d066da392a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8516a8b-77b8-41cd-a07a-9d066da392a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1', 'volume_name': 'volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334c8d7c-b098-403c-8aa8-6ab808ba54dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334c8d7c-b098-403c-8aa8-6ab808ba54dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ec21d0-a07f-41f2-8217-e12f594d09b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Volume 7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1', 'volume_size': 1}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:21 devstack quobyte-client[79699]: System call "lookup" of process 96595 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:21 devstack quobyte-client[79699]: System call "create" of process 96595 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:21 devstack quobyte-client[79699]: System call "getattr" of process 96595 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b3dcc0-d5a7-4650-a2a6-d15dc9edff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762aca41-4333-45ee-a1e0-7f43a30d440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3 (cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3): created successfully
Sep 30 20:36:21 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=147, name=volume-97bb75c0-cdba-4b04-8077-68a27ce37473, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762aca41-4333-45ee-a1e0-7f43a30d440d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (f78f19ac-fb90-4449-9dd2-2e0c6df7aa79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-733a5aad-fbc5-4861-bc8a-679572520bb1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created volume successfully.
Sep 30 20:36:21 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (7398a551-388e-40e0-8e10-1435a5cea517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db82bd2b-5b32-46da-93bf-0bc88af2e277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-97bb75c0-cdba-4b04-8077-68a27ce37473 1073741824" returned: 0 in 0.202s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-97bb75c0-cdba-4b04-8077-68a27ce37473 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db82bd2b-5b32-46da-93bf-0bc88af2e277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926975592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85af617-b443-414b-9caf-859e9df7b58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:21Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b32904-515a-4aef-b8fa-d8b0697e9fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b32904-515a-4aef-b8fa-d8b0697e9fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5f90b4-c47e-435b-b018-38e7110b4719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5f90b4-c47e-435b-b018-38e7110b4719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85af617-b443-414b-9caf-859e9df7b58b', 'volume_name': 'volume-a85af617-b443-414b-9caf-859e9df7b58b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef81b71-9291-4b45-bf02-fcaf85209d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef81b71-9291-4b45-bf02-fcaf85209d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604eb064-9a59-49a2-9b04-4535054ae95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Volume a85af617-b443-414b-9caf-859e9df7b58b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85af617-b443-414b-9caf-859e9df7b58b', 'volume_size': 1}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-97bb75c0-cdba-4b04-8077-68a27ce37473" returned: 0 in 0.057s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] <== create_volume: return (264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.267s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.198s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-608371773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:21Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Creating volume 7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dd5ee1-c8d6-4a40-a72a-71103ccdef96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bb75c0-cdba-4b04-8077-68a27ce37473', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b74816c-08ac-4261-ac53-7617e81da14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Volume volume-97bb75c0-cdba-4b04-8077-68a27ce37473 (97bb75c0-cdba-4b04-8077-68a27ce37473): created successfully
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b74816c-08ac-4261-ac53-7617e81da14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (f3165560-75b2-49d5-ac84-187756f060e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3680aa34-9b08-412d-9dbb-ede8bd96f1f1 tempest-CreateVolumesFromImageTest-550919608 None] Created volume successfully.
Sep 30 20:36:21 devstack quobyte-client[79699]: System call "lookup" of process 96599 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:21 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=148, name=volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:21 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (842cbcf7-48b7-4b84-a13b-30b3ec7a33b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6c1cc9-b007-4106-8ce5-8356e796c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1 1073741824" returned: 0 in 0.191s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6c1cc9-b007-4106-8ce5-8356e796c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128526310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c4478a-ef9d-422a-8168-46d7d04e7db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:22Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68027793-0010-4391-9c54-d27fbe7e678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68027793-0010-4391-9c54-d27fbe7e678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e039c7a-76fb-458a-81d0-0e0b71147dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e039c7a-76fb-458a-81d0-0e0b71147dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c4478a-ef9d-422a-8168-46d7d04e7db2', 'volume_name': 'volume-48c4478a-ef9d-422a-8168-46d7d04e7db2', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c93184-d584-4875-a3ea-19b5e34bb55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c93184-d584-4875-a3ea-19b5e34bb55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90664d8b-e9fd-4e89-904e-518660ece609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Volume 48c4478a-ef9d-422a-8168-46d7d04e7db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c4478a-ef9d-422a-8168-46d7d04e7db2', 'volume_size': 1}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1" returned: 0 in 0.064s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] <== create_volume: return (261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.263s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-926975592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85af617-b443-414b-9caf-859e9df7b58b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:21Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Creating volume a85af617-b443-414b-9caf-859e9df7b58b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a85af617-b443-414b-9caf-859e9df7b58b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ec21d0-a07f-41f2-8217-e12f594d09b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b2dc11-6d39-4288-ad2b-e9785eb8f08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Volume volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1 (7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1): created successfully
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b2dc11-6d39-4288-ad2b-e9785eb8f08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (cc2ca718-39e6-4e7e-b9ad-daaf8a27e3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-4e588e2c-e57f-44d1-8b84-b4167477b2ad tempest-CreateVolumesFromImageTest-550919608 None] Created volume successfully.
Sep 30 20:36:21 devstack quobyte-client[79699]: System call "ioctl" of process 96603 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:21 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=149, name=volume-a85af617-b443-414b-9caf-859e9df7b58b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a85af617-b443-414b-9caf-859e9df7b58b 1073741824" returned: 0 in 0.193s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a85af617-b443-414b-9caf-859e9df7b58b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a85af617-b443-414b-9caf-859e9df7b58b" returned: 0 in 0.028s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] <== create_volume: return (227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.229s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.242s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128526310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c4478a-ef9d-422a-8168-46d7d04e7db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:22Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Creating volume 48c4478a-ef9d-422a-8168-46d7d04e7db2 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:21 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48c4478a-ef9d-422a-8168-46d7d04e7db2 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604eb064-9a59-49a2-9b04-4535054ae95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85af617-b443-414b-9caf-859e9df7b58b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:21 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303d86ef-0dc0-4388-b5a7-838ec9640a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Volume volume-a85af617-b443-414b-9caf-859e9df7b58b (a85af617-b443-414b-9caf-859e9df7b58b): created successfully
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303d86ef-0dc0-4388-b5a7-838ec9640a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (7398a551-388e-40e0-8e10-1435a5cea517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-10cd6e03-cdd7-4af8-bd73-840926da0505 tempest-CreateVolumesFromImageTest-550919608 None] Created volume successfully.
Sep 30 20:36:22 devstack quobyte-client[79699]: System call "lookup" of process 96607 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:22 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=150, name=volume-48c4478a-ef9d-422a-8168-46d7d04e7db2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (72428d84-145e-435c-8128-8e7198c431d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa09200f-b93f-42ef-a4b4-e06be14c6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa09200f-b93f-42ef-a4b4-e06be14c6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-610951229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8f51c8-36b6-4788-ac05-570a8439bd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:22Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bced9350-a29a-4bcb-a6d8-5f06638a156d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bced9350-a29a-4bcb-a6d8-5f06638a156d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b64a1a-1db6-4236-a0c7-3dabe5705c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b64a1a-1db6-4236-a0c7-3dabe5705c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8f51c8-36b6-4788-ac05-570a8439bd5b', 'volume_name': 'volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d6334b-702d-4411-9cd7-d98be2f0a2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d6334b-702d-4411-9cd7-d98be2f0a2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac73cf7-715f-4946-8a19-e77b2dcec7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Volume 4e8f51c8-36b6-4788-ac05-570a8439bd5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b', 'volume_size': 1}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48c4478a-ef9d-422a-8168-46d7d04e7db2 1073741824" returned: 0 in 0.196s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48c4478a-ef9d-422a-8168-46d7d04e7db2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48c4478a-ef9d-422a-8168-46d7d04e7db2" returned: 0 in 0.033s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] <== create_volume: return (238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.241s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-610951229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8f51c8-36b6-4788-ac05-570a8439bd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbad21e42024d25b99e00849e78cf45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:22Z,use_quota=True,user_id='14e2046de2c0424d9ee66bc6a8dcd6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Creating volume 4e8f51c8-36b6-4788-ac05-570a8439bd5b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90664d8b-e9fd-4e89-904e-518660ece609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c4478a-ef9d-422a-8168-46d7d04e7db2', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8be8e80-e285-4f55-919b-eb213e82bcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=151, name=volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Volume volume-48c4478a-ef9d-422a-8168-46d7d04e7db2 (48c4478a-ef9d-422a-8168-46d7d04e7db2): created successfully
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8be8e80-e285-4f55-919b-eb213e82bcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (842cbcf7-48b7-4b84-a13b-30b3ec7a33b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-17d79d51-c8ad-405d-b389-1c6432901926 tempest-CreateVolumesFromImageTest-550919608 None] Created volume successfully.
Sep 30 20:36:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (536e1ccf-ea64-48f1-926b-4066282cc621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9ccd98-c6b1-482a-ba4e-11b14cfac1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9ccd98-c6b1-482a-ba4e-11b14cfac1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103992316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7623090-a0e9-4dd7-9c68-2178454d5628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:22Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7628ace-a4ca-4273-a1cd-2d7926b683d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7628ace-a4ca-4273-a1cd-2d7926b683d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192b908a-6ffe-4b74-a121-c3bcdf600f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (192b908a-6ffe-4b74-a121-c3bcdf600f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7623090-a0e9-4dd7-9c68-2178454d5628', 'volume_name': 'volume-c7623090-a0e9-4dd7-9c68-2178454d5628', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4575079-87d9-4f6a-b176-2ff557009cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4575079-87d9-4f6a-b176-2ff557009cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e711325-fbff-4315-afea-b0818c1fb892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume c7623090-a0e9-4dd7-9c68-2178454d5628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7623090-a0e9-4dd7-9c68-2178454d5628', 'volume_size': 1}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b 1073741824" returned: 0 in 0.201s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] <== create_volume: return (243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.246s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.063s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103992316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7623090-a0e9-4dd7-9c68-2178454d5628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:22Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Creating volume c7623090-a0e9-4dd7-9c68-2178454d5628 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c7623090-a0e9-4dd7-9c68-2178454d5628 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac73cf7-715f-4946-8a19-e77b2dcec7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9905ce5e-fad0-4784-8991-fc352eb88bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Volume volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b (4e8f51c8-36b6-4788-ac05-570a8439bd5b): created successfully
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9905ce5e-fad0-4784-8991-fc352eb88bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Flow 'volume_create_manager' (72428d84-145e-435c-8128-8e7198c431d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d55fd203-825d-4d5e-afcf-1e52ec9a5b9c tempest-CreateVolumesFromImageTest-550919608 None] Created volume successfully.
Sep 30 20:36:22 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=152, name=volume-c7623090-a0e9-4dd7-9c68-2178454d5628, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (94bcb2d6-bc7c-44b2-a50d-b8e3b1480766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab70167-eae0-4418-9cd8-e05b1f02b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c7623090-a0e9-4dd7-9c68-2178454d5628 1073741824" returned: 0 in 0.183s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c7623090-a0e9-4dd7-9c68-2178454d5628 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab70167-eae0-4418-9cd8-e05b1f02b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52077310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8782f875-3022-4130-9e9c-b7c8db75bdb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482ce759-6bca-477b-9cb8-b19820da2765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482ce759-6bca-477b-9cb8-b19820da2765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e96d96-3a55-4240-b5bf-6b2109d3606a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e96d96-3a55-4240-b5bf-6b2109d3606a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8782f875-3022-4130-9e9c-b7c8db75bdb8', 'volume_name': 'volume-8782f875-3022-4130-9e9c-b7c8db75bdb8', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5906102c-3235-4f56-8b46-618203890834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5906102c-3235-4f56-8b46-618203890834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a011e303-396d-4a17-8f3f-5edc7e2bb0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume 8782f875-3022-4130-9e9c-b7c8db75bdb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8782f875-3022-4130-9e9c-b7c8db75bdb8', 'volume_size': 1}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c7623090-a0e9-4dd7-9c68-2178454d5628" returned: 0 in 0.059s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] <== create_volume: return (261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.264s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-52077310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8782f875-3022-4130-9e9c-b7c8db75bdb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Creating volume 8782f875-3022-4130-9e9c-b7c8db75bdb8 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8782f875-3022-4130-9e9c-b7c8db75bdb8 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e711325-fbff-4315-afea-b0818c1fb892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7623090-a0e9-4dd7-9c68-2178454d5628', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330102e4-ed41-404a-80f3-40d7d3fd321c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume volume-c7623090-a0e9-4dd7-9c68-2178454d5628 (c7623090-a0e9-4dd7-9c68-2178454d5628): created successfully
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (330102e4-ed41-404a-80f3-40d7d3fd321c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (536e1ccf-ea64-48f1-926b-4066282cc621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:22 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-197fb467-b9d3-44b7-817c-f32811471328 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created volume successfully.
Sep 30 20:36:22 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=153, name=volume-8782f875-3022-4130-9e9c-b7c8db75bdb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:22 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (588e643c-b59b-4f3c-94be-39f3cf09e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd126354-975f-47cb-95eb-315264b9f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8782f875-3022-4130-9e9c-b7c8db75bdb8 1073741824" returned: 0 in 0.208s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:22 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8782f875-3022-4130-9e9c-b7c8db75bdb8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd126354-975f-47cb-95eb-315264b9f87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-486385106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e410c7-c16b-491a-8310-372cdb3ee84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8a16ab-eb1a-4393-981a-54fbb7f3c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8a16ab-eb1a-4393-981a-54fbb7f3c378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bacc104b-d5a2-4e22-850c-d234b91c2889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bacc104b-d5a2-4e22-850c-d234b91c2889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e410c7-c16b-491a-8310-372cdb3ee84a', 'volume_name': 'volume-15e410c7-c16b-491a-8310-372cdb3ee84a', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d455e4-a76f-4102-b4d8-ab20c1ba8230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d455e4-a76f-4102-b4d8-ab20c1ba8230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d394dc-8d2d-415f-a56c-7b9e4c8fccf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume 15e410c7-c16b-491a-8310-372cdb3ee84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e410c7-c16b-491a-8310-372cdb3ee84a', 'volume_size': 1}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8782f875-3022-4130-9e9c-b7c8db75bdb8" returned: 0 in 0.090s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] <== create_volume: return (306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.309s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-486385106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e410c7-c16b-491a-8310-372cdb3ee84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Creating volume 15e410c7-c16b-491a-8310-372cdb3ee84a {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-15e410c7-c16b-491a-8310-372cdb3ee84a 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=154, name=volume-15e410c7-c16b-491a-8310-372cdb3ee84a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a011e303-396d-4a17-8f3f-5edc7e2bb0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8782f875-3022-4130-9e9c-b7c8db75bdb8', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d42dd3e-a404-4576-8454-62e37013c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (7461e277-70d2-4a1a-9041-4060d537ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c8e47b-d21e-4ee3-abea-9a50c128771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume volume-8782f875-3022-4130-9e9c-b7c8db75bdb8 (8782f875-3022-4130-9e9c-b7c8db75bdb8): created successfully
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d42dd3e-a404-4576-8454-62e37013c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (94bcb2d6-bc7c-44b2-a50d-b8e3b1480766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c8e47b-d21e-4ee3-abea-9a50c128771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1946276536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7748efb9-bcee-432c-a34a-980313bf121d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbef51b9-82e9-48da-b9a9-0438d108f4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbef51b9-82e9-48da-b9a9-0438d108f4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b18fb0-5145-43c1-8610-d355533dd4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b18fb0-5145-43c1-8610-d355533dd4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7748efb9-bcee-432c-a34a-980313bf121d', 'volume_name': 'volume-7748efb9-bcee-432c-a34a-980313bf121d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a14972e-71aa-47d2-a4c4-41c1457f90df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a14972e-71aa-47d2-a4c4-41c1457f90df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c6129-3b16-4785-9db1-370497339887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume 7748efb9-bcee-432c-a34a-980313bf121d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7748efb9-bcee-432c-a34a-980313bf121d', 'volume_size': 1}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-15e410c7-c16b-491a-8310-372cdb3ee84a 1073741824" returned: 0 in 0.187s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-15e410c7-c16b-491a-8310-372cdb3ee84a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5d63cea0-282a-4402-b794-2b4ac214a8c0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created volume successfully.
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-15e410c7-c16b-491a-8310-372cdb3ee84a" returned: 0 in 0.053s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] <== create_volume: return (250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.253s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1946276536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7748efb9-bcee-432c-a34a-980313bf121d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Creating volume 7748efb9-bcee-432c-a34a-980313bf121d {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7748efb9-bcee-432c-a34a-980313bf121d 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d394dc-8d2d-415f-a56c-7b9e4c8fccf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e410c7-c16b-491a-8310-372cdb3ee84a', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4d7221-e2b4-45c5-9ade-ba90e90a5239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:23 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=155, name=volume-7748efb9-bcee-432c-a34a-980313bf121d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Flow 'volume_create_manager' (da8d6084-672c-4794-a3c5-0fb939f97ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b23fcb9-0f37-4f47-b4ba-d23d249e6297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b23fcb9-0f37-4f47-b4ba-d23d249e6297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22143ed8-d051-4156-bcf3-8ae30fe9adb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f12737a089480c920997fa46742658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='f9a35ca0eefc489694e455a354b2f58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b977c335-73cb-4a71-b2ee-f77a0c3d35a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b977c335-73cb-4a71-b2ee-f77a0c3d35a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84ba9ba-b25e-4cbc-9916-c45b687589b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.image.glance [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Creating Keystone auth plugin from conf {{(pid=79893) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume volume-15e410c7-c16b-491a-8310-372cdb3ee84a (15e410c7-c16b-491a-8310-372cdb3ee84a): created successfully
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4d7221-e2b4-45c5-9ade-ba90e90a5239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (588e643c-b59b-4f3c-94be-39f3cf09e844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-65957dbf-7dda-43a2-b9a4-ceab229a851b tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created volume successfully.
Sep 30 20:36:23 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (a14dc6b6-c788-4bff-bf17-92cb24f6d383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a693618-5a63-48c7-9442-7a30528b6909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-4e8f51c8-36b6-4788-ac05-570a8439bd5b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7748efb9-bcee-432c-a34a-980313bf121d 1073741824" returned: 0 in 0.218s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7748efb9-bcee-432c-a34a-980313bf121d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a693618-5a63-48c7-9442-7a30528b6909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248718561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fec831-868f-4a68-9a06-5352810cede9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e3cdbc-bdaa-4733-a369-098ec8022805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e3cdbc-bdaa-4733-a369-098ec8022805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a171b73e-5b48-4367-a696-15d4553bbc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a171b73e-5b48-4367-a696-15d4553bbc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fec831-868f-4a68-9a06-5352810cede9', 'volume_name': 'volume-95fec831-868f-4a68-9a06-5352810cede9', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc05ce7-831f-4318-ac73-bdfa31a37495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc05ce7-831f-4318-ac73-bdfa31a37495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a88c882-de93-4825-9b0b-09a5e1dd6997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume 95fec831-868f-4a68-9a06-5352810cede9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fec831-868f-4a68-9a06-5352810cede9', 'volume_size': 1}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-4e8f51c8-36b6-4788-ac05-570a8439bd5b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7748efb9-bcee-432c-a34a-980313bf121d" returned: 0 in 0.064s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] <== create_volume: return (294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.299s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1248718561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fec831-868f-4a68-9a06-5352810cede9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9624393fa054c25a66cc43d8936de8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='ef002282ac864c419802ee0ec369e272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Creating volume 95fec831-868f-4a68-9a06-5352810cede9 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95fec831-868f-4a68-9a06-5352810cede9 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c6129-3b16-4785-9db1-370497339887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7748efb9-bcee-432c-a34a-980313bf121d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b136f4-34f0-496c-b452-d39791faf633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack quobyte-client[79699]: System call "create" of process 96631 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:23 devstack quobyte-client[79699]: System call "getattr" of process 96631 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:23 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=156, name=volume-95fec831-868f-4a68-9a06-5352810cede9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:23 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-quobyte-4e8f51c8-36b6-4788-ac05-570a8439bd5b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume volume-7748efb9-bcee-432c-a34a-980313bf121d (7748efb9-bcee-432c-a34a-980313bf121d): created successfully
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b136f4-34f0-496c-b452-d39791faf633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (7461e277-70d2-4a1a-9041-4060d537ca47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-49b8ce94-2a02-4a81-b6c6-126826c46817 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created volume successfully.
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-4e8f51c8-36b6-4788-ac05-570a8439bd5b" acquired by "delete_volume" :: waited 0.031s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9be3304-bdc6-4c01-8797-5da8478a7239]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84ba9ba-b25e-4cbc-9916-c45b687589b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22143ed8-d051-4156-bcf3-8ae30fe9adb4', 'volume_name': 'volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4', 'volume_size': 1, 'image_id': '6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4bce5bfbab3daeaaa991fd71cf2d715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56f12737a089480c920997fa46742658', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '357d349f3ad2b905198575889b207b7bda1aa25a850e4acf8b17458edf301c67c24d24279961d2df9a1fcedbed745aa20b56702220d0646990b5c4865270e0e5', 'id': '6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'created_at': datetime.datetime(2025, 9, 30, 18, 36, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 36, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733af9e10>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a748f248-1b54-42c8-8d94-f3c35e3a95b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a748f248-1b54-42c8-8d94-f3c35e3a95b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d57be8c-0aac-406d-a27d-304fc7a42583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Volume 22143ed8-d051-4156-bcf3-8ae30fe9adb4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4', 'volume_size': 1, 'image_id': '6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4bce5bfbab3daeaaa991fd71cf2d715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56f12737a089480c920997fa46742658', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '357d349f3ad2b905198575889b207b7bda1aa25a850e4acf8b17458edf301c67c24d24279961d2df9a1fcedbed745aa20b56702220d0646990b5c4865270e0e5', 'id': '6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'created_at': datetime.datetime(2025, 9, 30, 18, 36, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 36, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733af9e10>}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Cloning 22143ed8-d051-4156-bcf3-8ae30fe9adb4 from image 6490ee9c-7dfd-4bc4-91fb-2db99803b06b  at location (None, [{'url': 'file:///opt/stack/data/glance/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'metadata': {}}]). {{(pid=79893) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95fec831-868f-4a68-9a06-5352810cede9 1073741824" returned: 0 in 0.155s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95fec831-868f-4a68-9a06-5352810cede9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95fec831-868f-4a68-9a06-5352810cede9" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] <== create_volume: return (185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.188s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a88c882-de93-4825-9b0b-09a5e1dd6997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fec831-868f-4a68-9a06-5352810cede9', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3ae12a-2f09-4a94-9b93-52eb43f9240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume volume-95fec831-868f-4a68-9a06-5352810cede9 (95fec831-868f-4a68-9a06-5352810cede9): created successfully
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3ae12a-2f09-4a94-9b93-52eb43f9240d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Flow 'volume_create_manager' (a14dc6b6-c788-4bff-bf17-92cb24f6d383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-910025b2-013c-4c11-a73c-d9a5211b540a tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created volume successfully.
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 30 20:36:23 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Image download 0.00 MB at 0.00 MB/s
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1db27e6-705c-4052-b45e-bff56fa51656]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b" returned: 0 in 0.236s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4e8f51c8-36b6-4788-ac05-570a8439bd5b" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:23 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-4e8f51c8-36b6-4788-ac05-570a8439bd5b" released by "delete_volume" :: held 0.283s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Created reservations ['76939f42-d13b-42dd-b32b-1e776e698981', '3f8c834d-f572-49d9-9e72-500c152ecbc7', 'f3496206-4d16-4082-ae5f-a89f3f7ab635', '57cf5109-10de-4fe8-bffa-e5accfe9d77e'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:24 devstack sudo[96637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD
Sep 30 20:36:24 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:24 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Deleted volume successfully.
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-51b548a8-7038-426b-a842-3158e416c88a tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-4e8f51c8-36b6-4788-ac05-570a8439bd5b-delete_volume" released by "delete_volume" :: held 0.510s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:24 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD" returned: 0 in 0.632s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-95fec831-868f-4a68-9a06-5352810cede9-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-95fec831-868f-4a68-9a06-5352810cede9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-48c4478a-ef9d-422a-8168-46d7d04e7db2-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:24 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD
Sep 30 20:36:24 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:36:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-quobyte-95fec831-868f-4a68-9a06-5352810cede9" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-48c4478a-ef9d-422a-8168-46d7d04e7db2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-95fec831-868f-4a68-9a06-5352810cede9" acquired by "delete_volume" :: waited 0.020s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c80fd9-033b-4ad5-828a-59ae2a2dd5da]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95fec831-868f-4a68-9a06-5352810cede9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:24 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-quobyte-48c4478a-ef9d-422a-8168-46d7d04e7db2" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-48c4478a-ef9d-422a-8168-46d7d04e7db2" acquired by "delete_volume" :: waited 0.018s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd38b2d-ee50-460f-8d9c-04b81d805406]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:24 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48c4478a-ef9d-422a-8168-46d7d04e7db2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48c4478a-ef9d-422a-8168-46d7d04e7db2" returned: 0 in 0.164s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48c4478a-ef9d-422a-8168-46d7d04e7db2 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95fec831-868f-4a68-9a06-5352810cede9" returned: 0 in 0.286s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95fec831-868f-4a68-9a06-5352810cede9 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-48c4478a-ef9d-422a-8168-46d7d04e7db2" returned: 0 in 0.049s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-48c4478a-ef9d-422a-8168-46d7d04e7db2" released by "delete_volume" :: held 0.247s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-95fec831-868f-4a68-9a06-5352810cede9" returned: 0 in 0.037s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-95fec831-868f-4a68-9a06-5352810cede9" released by "delete_volume" :: held 0.367s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Created reservations ['4fb8206c-d4e9-4868-81f2-2f4bea047770', 'b3cf0daf-d951-4e2f-a2a5-2dbff74d6f7b', '527eee0f-1833-4452-88a0-031d3da9bd7b', '74f0a71a-dce7-4296-993d-adc51bbb5eb8'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created reservations ['e6569655-3023-47d7-a377-b4e879390f9c', '8331b36d-9939-49c5-a49e-4b0ae2f46a38', '0d6673ee-b657-49dd-a5bf-9ce332eaa9b2', '701c6633-1c1d-4fc2-be48-ca1a3749bb02'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.050s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Deleted volume successfully.
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-57a28304-c135-47c3-9997-2200e9c960f4 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-48c4478a-ef9d-422a-8168-46d7d04e7db2-delete_volume" released by "delete_volume" :: held 0.583s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.045s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:25 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Deleted volume successfully.
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8485003e-cc41-4c90-b414-2ef2d6580ad1 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-95fec831-868f-4a68-9a06-5352810cede9-delete_volume" released by "delete_volume" :: held 0.688s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:25 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD" returned: 1 in 0.829s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Temporary image 6490ee9c-7dfd-4bc4-91fb-2db99803b06b is fetched for user f9a35ca0eefc489694e455a354b2f58a. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8360142-f338-4a02-b789-b2029e47f056]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:25 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD
Sep 30 20:36:25 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-7748efb9-bcee-432c-a34a-980313bf121d-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-7748efb9-bcee-432c-a34a-980313bf121d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-a85af617-b443-414b-9caf-859e9df7b58b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-quobyte-7748efb9-bcee-432c-a34a-980313bf121d" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-a85af617-b443-414b-9caf-859e9df7b58b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-7748efb9-bcee-432c-a34a-980313bf121d" acquired by "delete_volume" :: waited 0.031s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d19be8-080c-4170-af58-edd9391c6d9e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7748efb9-bcee-432c-a34a-980313bf121d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:25 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-quobyte-a85af617-b443-414b-9caf-859e9df7b58b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-a85af617-b443-414b-9caf-859e9df7b58b" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fd1500-48cc-44e5-84be-f2ead956cdfd]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:25 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a85af617-b443-414b-9caf-859e9df7b58b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7748efb9-bcee-432c-a34a-980313bf121d" returned: 0 in 0.220s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7748efb9-bcee-432c-a34a-980313bf121d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:26 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD" returned: 0 in 0.741s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7748efb9-bcee-432c-a34a-980313bf121d" returned: 0 in 0.049s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-7748efb9-bcee-432c-a34a-980313bf121d" released by "delete_volume" :: held 0.304s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a85af617-b443-414b-9caf-859e9df7b58b" returned: 0 in 0.230s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a85af617-b443-414b-9caf-859e9df7b58b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-a85af617-b443-414b-9caf-859e9df7b58b" returned: 0 in 0.047s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-a85af617-b443-414b-9caf-859e9df7b58b" released by "delete_volume" :: held 0.305s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created reservations ['561f959b-4f91-4b6e-a113-0e69d917a1d4', '31db13d3-6d7c-4883-9b7b-b043cf15dc21', 'c72e28af-d294-4856-a125-022d09211622', '8c6e3626-4142-40c5-8899-db57b338a848'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Created reservations ['dcbfc0dc-98ce-4a5d-a97d-31f42b3fbe01', '153cddf5-55ef-435d-a31b-914564b41409', '8ba3962b-25e7-4552-ab5d-d88c4f419522', '0cee1213-a4ca-4f75-b520-a274f7f37bf1'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:26 devstack sudo[96669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD
Sep 30 20:36:26 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:26 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Deleted volume successfully.
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-5d68f5a5-513a-4c9b-a2df-21058ecfe865 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-7748efb9-bcee-432c-a34a-980313bf121d-delete_volume" released by "delete_volume" :: held 0.619s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:26 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Deleted volume successfully.
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-acadbdf3-596d-45c8-998d-682de8e8e042 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-a85af617-b443-414b-9caf-859e9df7b58b-delete_volume" released by "delete_volume" :: held 0.583s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:26 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:36:26 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD" returned: 1 in 0.624s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22143ed8-d051-4156-bcf3-8ae30fe9adb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56f12737a089480c920997fa46742658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:23Z,use_quota=True,user_id='f9a35ca0eefc489694e455a354b2f58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Creating volume 22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:26 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:26 devstack quobyte-client[79699]: System call "getlk" of process 96679 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:26 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=157, name=volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 1073741824" returned: 0 in 0.129s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-15e410c7-c16b-491a-8310-372cdb3ee84a-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-15e410c7-c16b-491a-8310-372cdb3ee84a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4" returned: 0 in 0.059s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:26 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] <== create_volume: return (195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.197s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Attempting download of 6490ee9c-7dfd-4bc4-91fb-2db99803b06b ((None, [{'url': 'file:///opt/stack/data/glance/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'metadata': {}}])) to volume 22143ed8-d051-4156-bcf3-8ae30fe9adb4. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 30 20:36:27 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-quobyte-15e410c7-c16b-491a-8310-372cdb3ee84a" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-15e410c7-c16b-491a-8310-372cdb3ee84a" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[518fb477-ba21-428d-97e6-7a043b2a5bd1]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-15e410c7-c16b-491a-8310-372cdb3ee84a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2129b5d-d048-466d-ae55-c9099746a775]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_mm7_zzxi {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:27 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-quobyte-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba337bc-7070-4f02-84f4-9a95dda33b71]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-15e410c7-c16b-491a-8310-372cdb3ee84a" returned: 0 in 0.155s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-15e410c7-c16b-491a-8310-372cdb3ee84a {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_mm7_zzxi" returned: 0 in 0.147s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_mm7_zzxi {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-15e410c7-c16b-491a-8310-372cdb3ee84a" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-15e410c7-c16b-491a-8310-372cdb3ee84a" released by "delete_volume" :: held 0.206s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1" returned: 0 in 0.177s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created reservations ['9ff3a848-bbbe-41cf-92f4-4237ff7491b4', '15a88e76-835c-4b9f-8497-0e1210c23afc', '40a5185c-4c12-4bbc-b712-670b761c138b', 'd3bbab8e-35db-4ac2-ac52-65dcaca3dcd7'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1" released by "delete_volume" :: held 0.232s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_mm7_zzxi" returned: 1 in 0.168s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_mm7_zzxi' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[732df1ed-c864-4ccb-b736-86ec8da21164]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Created reservations ['5c4f2291-b99c-493e-be19-54236058dbe7', '1ab20552-eb03-467e-902b-92a08de9f412', 'ab6cd8a1-74f9-4b8e-a1e6-0327b623289b', '9427513b-534d-46b4-931f-545ac8bdc190'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.058s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:27 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Deleted volume successfully.
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8f046710-7c96-4340-b927-6d9378af7867 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-15e410c7-c16b-491a-8310-372cdb3ee84a-delete_volume" released by "delete_volume" :: held 0.528s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.048s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:27 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Deleted volume successfully.
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-71075f21-e7a0-4537-850d-3e2d40c4e05d tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-7ecd82cb-6d5d-4a6d-adc7-fccc9658b9d1-delete_volume" released by "delete_volume" :: held 0.478s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD" returned: 1 in 0.160s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] 6490ee9c-7dfd-4bc4-91fb-2db99803b06b was raw, converting to raw {{(pid=79893) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=157, name=volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4" returned: 0 in 0.090s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6490ee9c-7dfd-4bc4-91fb-2db99803b06b_vz60_72_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:36:27 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Converted 0.00 MB image at 0.00 MB/s
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 1G" returned: 0 in 0.054s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3076e-663b-48e8-9e32-6de1096c1cb0]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:27 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack quobyte-client[79699]: System call "open" of process 96709 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4" returned: 0 in 0.176s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-8782f875-3022-4130-9e9c-b7c8db75bdb8-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-8782f875-3022-4130-9e9c-b7c8db75bdb8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-quobyte-8782f875-3022-4130-9e9c-b7c8db75bdb8" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-8782f875-3022-4130-9e9c-b7c8db75bdb8" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0cb24b-8132-4369-a81b-fd406a085c18]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8782f875-3022-4130-9e9c-b7c8db75bdb8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-97bb75c0-cdba-4b04-8077-68a27ce37473-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-97bb75c0-cdba-4b04-8077-68a27ce37473-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4" returned: 1 in 0.186s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Downloaded image 6490ee9c-7dfd-4bc4-91fb-2db99803b06b ((None, [{'url': 'file:///opt/stack/data/glance/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'metadata': {}}])) to volume 22143ed8-d051-4156-bcf3-8ae30fe9adb4 successfully. {{(pid=79893) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Temporary image 6490ee9c-7dfd-4bc4-91fb-2db99803b06b for user f9a35ca0eefc489694e455a354b2f58a is deleted. {{(pid=79893) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.volume_utils [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Marking volume 22143ed8-d051-4156-bcf3-8ae30fe9adb4 as bootable. {{(pid=79893) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Copying metadata from image 6490ee9c-7dfd-4bc4-91fb-2db99803b06b to 22143ed8-d051-4156-bcf3-8ae30fe9adb4. {{(pid=79893) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Creating volume glance metadata for volume 22143ed8-d051-4156-bcf3-8ae30fe9adb4 backed by image 6490ee9c-7dfd-4bc4-91fb-2db99803b06b with: {'image_id': '6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a4bce5bfbab3daeaaa991fd71cf2d715', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=79893) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 30 20:36:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "cinder-quobyte-97bb75c0-cdba-4b04-8077-68a27ce37473" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-97bb75c0-cdba-4b04-8077-68a27ce37473" acquired by "delete_volume" :: waited 0.018s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e2d36-e678-47df-8275-00b0816e7414]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-97bb75c0-cdba-4b04-8077-68a27ce37473 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8782f875-3022-4130-9e9c-b7c8db75bdb8" returned: 0 in 0.180s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8782f875-3022-4130-9e9c-b7c8db75bdb8 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d57be8c-0aac-406d-a27d-304fc7a42583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4', 'volume_size': 1, 'image_id': '6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4bce5bfbab3daeaaa991fd71cf2d715', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56f12737a089480c920997fa46742658', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '357d349f3ad2b905198575889b207b7bda1aa25a850e4acf8b17458edf301c67c24d24279961d2df9a1fcedbed745aa20b56702220d0646990b5c4865270e0e5', 'id': '6490ee9c-7dfd-4bc4-91fb-2db99803b06b', 'created_at': datetime.datetime(2025, 9, 30, 18, 36, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 30, 18, 36, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6490ee9c-7dfd-4bc4-91fb-2db99803b06b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6733af9e10>}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f31c473-d459-43d1-be63-1017be73cb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-8782f875-3022-4130-9e9c-b7c8db75bdb8" returned: 0 in 0.047s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-8782f875-3022-4130-9e9c-b7c8db75bdb8" released by "delete_volume" :: held 0.261s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:28 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Volume volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 (22143ed8-d051-4156-bcf3-8ae30fe9adb4): created successfully
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f31c473-d459-43d1-be63-1017be73cb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Flow 'volume_create_manager' (da8d6084-672c-4794-a3c5-0fb939f97ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-93a4bdc9-e77a-45e6-be9d-3ae78afd5f2e tempest-VolumeImageDependencyTests-1931568096 None] Created volume successfully.
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created reservations ['01791cd5-0e3d-472a-95e2-a2f9d1f10bca', '2b61a05d-ef26-4060-9546-d2717c777892', '0c89ee62-9db2-493a-b2df-0d7bb930f624', '8aa23229-3160-418d-89d2-f16ce1ca9779'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-97bb75c0-cdba-4b04-8077-68a27ce37473" returned: 0 in 0.182s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-97bb75c0-cdba-4b04-8077-68a27ce37473 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.039s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Deleted volume successfully.
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-97bb75c0-cdba-4b04-8077-68a27ce37473" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-quobyte-97bb75c0-cdba-4b04-8077-68a27ce37473" released by "delete_volume" :: held 0.231s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-c18ada3b-95dd-48f1-a740-d4241f2f205f tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-8782f875-3022-4130-9e9c-b7c8db75bdb8-delete_volume" released by "delete_volume" :: held 0.443s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Created reservations ['aceeaf8b-1313-427c-82dd-fe861678fd97', '3d0efb05-6e84-4d9e-8ecd-36fba2c1f2e6', '14ceef2d-69d8-420f-b9fb-984d0580279f', 'da507f85-14bc-48df-bb7a-2a06982e71c5'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:28 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Deleted volume successfully.
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-3f74c187-77fd-49bb-b404-c6152d6245b5 tempest-CreateVolumesFromImageTest-550919608 None] Lock "cinder-97bb75c0-cdba-4b04-8077-68a27ce37473-delete_volume" released by "delete_volume" :: held 0.474s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Acquiring lock "cinder-22143ed8-d051-4156-bcf3-8ae30fe9adb4-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Lock "cinder-22143ed8-d051-4156-bcf3-8ae30fe9adb4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:28 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Acquiring lock "cinder-quobyte-22143ed8-d051-4156-bcf3-8ae30fe9adb4" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Lock "cinder-quobyte-22143ed8-d051-4156-bcf3-8ae30fe9adb4" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcf0195-9cb6-4630-b354-d718ba7c3601]: (4, 'raw') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4" returned: 0 in 0.135s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:28 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4" returned: 1 in 0.146s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4' failed. Not Retrying. {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-22143ed8-d051-4156-bcf3-8ae30fe9adb4" returned: 0 in 0.026s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Lock "cinder-quobyte-22143ed8-d051-4156-bcf3-8ae30fe9adb4" released by "delete_volume" :: held 0.349s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Created reservations ['20b3eab1-ba1d-4586-a9c9-19ddf2909e3a', '5b2be8fe-2007-4557-a598-3cf0f0f0c9da', '702292a4-d324-4279-b0d0-fcb2daa8f6e9', '47dd7c70-f832-4e58-b006-a8b01dbe5280'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Deleted volume successfully.
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-a58bf399-b28c-4cd1-9081-5654cdc6c872 tempest-VolumeImageDependencyTests-1931568096 None] Lock "cinder-22143ed8-d051-4156-bcf3-8ae30fe9adb4-delete_volume" released by "delete_volume" :: held 0.492s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-c7623090-a0e9-4dd7-9c68-2178454d5628-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-c7623090-a0e9-4dd7-9c68-2178454d5628-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:29 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-quobyte-c7623090-a0e9-4dd7-9c68-2178454d5628" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-c7623090-a0e9-4dd7-9c68-2178454d5628" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b83af00-5ecd-4176-b3d7-a3cb3c05b66c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c7623090-a0e9-4dd7-9c68-2178454d5628 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c7623090-a0e9-4dd7-9c68-2178454d5628" returned: 0 in 0.219s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c7623090-a0e9-4dd7-9c68-2178454d5628 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-c7623090-a0e9-4dd7-9c68-2178454d5628" returned: 0 in 0.027s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-c7623090-a0e9-4dd7-9c68-2178454d5628" released by "delete_volume" :: held 0.278s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created reservations ['23dbdd1f-5837-4f63-88d5-6034c60777e4', '9c9acf7e-8d63-4f76-ac29-e819ddd79f97', '7d8b4f4e-d303-480b-b1ab-25294a8f9f2f', 'b318f048-9862-4fe5-9661-d4d910353e31'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.040s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:29 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Deleted volume successfully.
Sep 30 20:36:29 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-862f0b37-3191-4c25-972d-7ec0c18bd7f0 tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-c7623090-a0e9-4dd7-9c68-2178454d5628-delete_volume" released by "delete_volume" :: held 0.465s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:30 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "cinder-quobyte-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3" acquired by "delete_volume" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4c13ea-07ed-4319-84c1-0b7af61207ea]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3" returned: 0 in 0.205s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3" returned: 0 in 0.044s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-quobyte-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3" released by "delete_volume" :: held 0.274s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Created reservations ['8f48d571-52d6-4e93-96cb-34eb8893bb57', '69eda9d5-507b-44bc-a2f2-94f637c13baa', 'db5a1aea-ea63-49c1-8119-782a895ff3ff', 'e4513420-5b06-4357-95e1-477ad2087a4f'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:30 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Deleted volume successfully.
Sep 30 20:36:30 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-8bfd23f0-dd6a-4c9c-95cf-2a18a7f0aaca tempest-CreateVolumesFromSourceVolumeTest-1004841947 None] Lock "cinder-cd664ec6-ad20-4b2e-bfdc-78ea6eb67db3-delete_volume" released by "delete_volume" :: held 0.513s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:31 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (21b7c7ce-32db-4b09-ab03-0e9bfe87d403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63769ba0-caf8-4773-ad5b-157779545ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63769ba0-caf8-4773-ad5b-157779545ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108007708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbf3f61-c736-4931-b388-fa989dbe3468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:31Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5958d852-2835-4d69-bcb5-5017df17f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5958d852-2835-4d69-bcb5-5017df17f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d50fd9-82db-4de1-abbc-a16c5aec1409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d50fd9-82db-4de1-abbc-a16c5aec1409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbf3f61-c736-4931-b388-fa989dbe3468', 'volume_name': 'volume-4fbf3f61-c736-4931-b388-fa989dbe3468', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f6b428-d40c-4f97-8004-18cecb285825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90f6b428-d40c-4f97-8004-18cecb285825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df65bf53-4ba7-4b83-a455-fa9f75f330e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:31 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume 4fbf3f61-c736-4931-b388-fa989dbe3468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbf3f61-c736-4931-b388-fa989dbe3468', 'volume_size': 1}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108007708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbf3f61-c736-4931-b388-fa989dbe3468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:31Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Creating volume 4fbf3f61-c736-4931-b388-fa989dbe3468 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:31 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:31 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=158, name=volume-4fbf3f61-c736-4931-b388-fa989dbe3468, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 1073741824" returned: 0 in 0.152s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] <== create_volume: return (183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.185s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df65bf53-4ba7-4b83-a455-fa9f75f330e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbf3f61-c736-4931-b388-fa989dbe3468', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75bf8e7-e6d4-4577-b663-e922e57e3398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:31 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume volume-4fbf3f61-c736-4931-b388-fa989dbe3468 (4fbf3f61-c736-4931-b388-fa989dbe3468): created successfully
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75bf8e7-e6d4-4577-b663-e922e57e3398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:31 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (21b7c7ce-32db-4b09-ab03-0e9bfe87d403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:31 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a3cd0919-f27d-4657-b724-1c666447c6b1 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created volume successfully.
Sep 30 20:36:32 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Creating offline snapshot 6fc4c253-730c-4ae8-a440-1418412a9e52 of volume 4fbf3f61-c736-4931-b388-fa989dbe3468 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af42c95-b103-4e60-b0bc-906fd9dfe60a]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468" returned: 0 in 0.199s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:32 devstack quobyte-client[79699]: System call "getattr" of process 96750 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:32 devstack quobyte-client[79699]: System call "lookup" of process 96750 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:32 devstack quobyte-client[79699]: System call "getattr" of process 96750 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:32 devstack quobyte-client[79699]: System call "open" of process 96750 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:32 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=159, name=volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 1G" returned: 0 in 0.139s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4fbf3f61-c736-4931-b388-fa989dbe3468 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img rebase -u -b volume-4fbf3f61-c736-4931-b388-fa989dbe3468 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52" returned: 0 in 0.042s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52" returned: 0 in 0.035s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:32 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.info" returned: 0 in 0.041s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.info" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.570s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:33 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-9b13e6e4-6c93-428a-a7a7-abb9eadf98bd tempest-CreateVolumesFromSnapshotTest-1235214650 None] Create snapshot completed successfully
Sep 30 20:36:33 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Flow 'volume_create_manager' (ee47bdd8-d106-481d-bc9d-7449422baeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5a2841-7088-4d10-94a3-f6407195ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5a2841-7088-4d10-94a3-f6407195ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6e86d8-093d-439a-9c42-272208c4ff21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e14d9d22d2b48e9acd55ac63e49c54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:33Z,use_quota=True,user_id='86ac699bf014482988da0737998d63cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8225edf-cb10-45f2-8f3c-4872789ad692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8225edf-cb10-45f2-8f3c-4872789ad692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32fc4c7-b537-4206-abb0-bc7a8a4c5ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32fc4c7-b537-4206-abb0-bc7a8a4c5ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6e86d8-093d-439a-9c42-272208c4ff21', 'volume_name': 'volume-2c6e86d8-093d-439a-9c42-272208c4ff21', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfaf1cab-5bba-4d96-91d2-4a58bb1df787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfaf1cab-5bba-4d96-91d2-4a58bb1df787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f054ec61-34c7-4546-b6c1-836549f608fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Volume 2c6e86d8-093d-439a-9c42-272208c4ff21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6e86d8-093d-439a-9c42-272208c4ff21', 'volume_size': 1}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6e86d8-093d-439a-9c42-272208c4ff21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e14d9d22d2b48e9acd55ac63e49c54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:33Z,use_quota=True,user_id='86ac699bf014482988da0737998d63cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Creating volume 2c6e86d8-093d-439a-9c42-272208c4ff21 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:33 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2c6e86d8-093d-439a-9c42-272208c4ff21 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:33 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=161, name=volume-2c6e86d8-093d-439a-9c42-272208c4ff21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2c6e86d8-093d-439a-9c42-272208c4ff21 1073741824" returned: 0 in 0.148s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2c6e86d8-093d-439a-9c42-272208c4ff21 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2c6e86d8-093d-439a-9c42-272208c4ff21" returned: 0 in 0.026s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] <== create_volume: return (189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.193s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f054ec61-34c7-4546-b6c1-836549f608fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6e86d8-093d-439a-9c42-272208c4ff21', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370ed5fc-6cd8-4efd-9dea-35a6c62b8f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Volume volume-2c6e86d8-093d-439a-9c42-272208c4ff21 (2c6e86d8-093d-439a-9c42-272208c4ff21): created successfully
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370ed5fc-6cd8-4efd-9dea-35a6c62b8f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Flow 'volume_create_manager' (ee47bdd8-d106-481d-bc9d-7449422baeea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:33 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-643d7295-4809-4e0a-823b-c445400bb8c7 tempest-CinderUnicodeTest-1832705403 None] Created volume successfully.
Sep 30 20:36:33 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (4be4cfa8-0656-43c0-803c-dadbf4c577c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3146fade-b6db-4d87-ba3d-afea57976e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3146fade-b6db-4d87-ba3d-afea57976e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-75716497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233548d1-3840-496d-9dc6-d251dc43932d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:34Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea612c99-fbc4-4284-a764-e3178fb41ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea612c99-fbc4-4284-a764-e3178fb41ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f9a21d-3877-418f-b857-e44f0cf401e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f9a21d-3877-418f-b857-e44f0cf401e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '233548d1-3840-496d-9dc6-d251dc43932d', 'volume_name': 'volume-233548d1-3840-496d-9dc6-d251dc43932d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9b8f34-7845-4d78-8951-858dd965f3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9b8f34-7845-4d78-8951-858dd965f3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109647ea-c901-46ce-a7c1-a7d7aeef0659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:33 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume 233548d1-3840-496d-9dc6-d251dc43932d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-233548d1-3840-496d-9dc6-d251dc43932d', 'volume_size': 1}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-75716497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=233548d1-3840-496d-9dc6-d251dc43932d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:34Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Creating volume 233548d1-3840-496d-9dc6-d251dc43932d {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:33 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:33 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-233548d1-3840-496d-9dc6-d251dc43932d 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:33 devstack quobyte-client[79699]: System call "getattr" of process 96764 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:33 devstack quobyte-client[79699]: System call "getattr" of process 96764 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:33 devstack quobyte-client[79699]: System call "lookup" of process 96764 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:33 devstack quobyte-client[79699]: System call "create" of process 96764 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:33 devstack quobyte-client[79699]: System call "getattr" of process 96764 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:33 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=162, name=volume-233548d1-3840-496d-9dc6-d251dc43932d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-233548d1-3840-496d-9dc6-d251dc43932d 1073741824" returned: 0 in 0.154s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-233548d1-3840-496d-9dc6-d251dc43932d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-233548d1-3840-496d-9dc6-d251dc43932d" returned: 0 in 0.029s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] <== create_volume: return (189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.192s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (618189c9-9b85-4b6a-a57c-fc28f332c651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1237c558-3db5-4acd-9f43-efcfd054c613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109647ea-c901-46ce-a7c1-a7d7aeef0659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-233548d1-3840-496d-9dc6-d251dc43932d', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97b6168-787a-41ac-9b93-156eed1ebd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1237c558-3db5-4acd-9f43-efcfd054c613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428447522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a33bc15-6442-4c3e-9171-34f8fe1be78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:34Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5caeea-77a9-4deb-a573-958476c88819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5caeea-77a9-4deb-a573-958476c88819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6486848-7616-434f-b89a-9975dfeb50bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6486848-7616-434f-b89a-9975dfeb50bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a33bc15-6442-4c3e-9171-34f8fe1be78b', 'volume_name': 'volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250fbede-ba57-49b3-b45a-a093cdd6e2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250fbede-ba57-49b3-b45a-a093cdd6e2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294b0062-cb6e-47da-bb76-1c3847cfefd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume 2a33bc15-6442-4c3e-9171-34f8fe1be78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b', 'volume_size': 1}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428447522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a33bc15-6442-4c3e-9171-34f8fe1be78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:34Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Creating volume 2a33bc15-6442-4c3e-9171-34f8fe1be78b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume volume-233548d1-3840-496d-9dc6-d251dc43932d (233548d1-3840-496d-9dc6-d251dc43932d): created successfully
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97b6168-787a-41ac-9b93-156eed1ebd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (4be4cfa8-0656-43c0-803c-dadbf4c577c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:34 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-a71b497f-3172-44f8-aad9-03beb3476e3c tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created volume successfully.
Sep 30 20:36:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:34 devstack quobyte-client[79699]: System call "open" of process 96768 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:34 devstack quobyte-client[79699]: System call "ioctl" of process 96768 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:34 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=163, name=volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (93206677-8d7e-4cea-929f-83cb59e8ada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a9afa2-d4cf-448d-83ab-91fd1467368c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a9afa2-d4cf-448d-83ab-91fd1467368c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267319891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3139c1c-0bed-4c3b-8932-1124b211e625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:34Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65135de8-777a-4418-b139-64f01ad2ed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65135de8-777a-4418-b139-64f01ad2ed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa51eaa-3c8d-4a1e-a260-d20b7ad12bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa51eaa-3c8d-4a1e-a260-d20b7ad12bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3139c1c-0bed-4c3b-8932-1124b211e625', 'volume_name': 'volume-d3139c1c-0bed-4c3b-8932-1124b211e625', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77a58b7-9a93-4c31-b7bc-a87074b24620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77a58b7-9a93-4c31-b7bc-a87074b24620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3661e3e1-0506-4e0e-8a3f-3c2948c7dc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume d3139c1c-0bed-4c3b-8932-1124b211e625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3139c1c-0bed-4c3b-8932-1124b211e625', 'volume_size': 1}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b 1073741824" returned: 0 in 0.174s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b" returned: 0 in 0.034s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] <== create_volume: return (218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.221s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267319891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3139c1c-0bed-4c3b-8932-1124b211e625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:34Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Creating volume d3139c1c-0bed-4c3b-8932-1124b211e625 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d3139c1c-0bed-4c3b-8932-1124b211e625 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294b0062-cb6e-47da-bb76-1c3847cfefd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b18a0ea-8b04-49e8-922e-06f84d02a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b (2a33bc15-6442-4c3e-9171-34f8fe1be78b): created successfully
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b18a0ea-8b04-49e8-922e-06f84d02a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (618189c9-9b85-4b6a-a57c-fc28f332c651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:34 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=164, name=volume-d3139c1c-0bed-4c3b-8932-1124b211e625, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-97f72130-7868-4618-92d7-eaaa64b71405 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created volume successfully.
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d3139c1c-0bed-4c3b-8932-1124b211e625 1073741824" returned: 0 in 0.166s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d3139c1c-0bed-4c3b-8932-1124b211e625 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d3139c1c-0bed-4c3b-8932-1124b211e625" returned: 0 in 0.037s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] <== create_volume: return (223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.230s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3661e3e1-0506-4e0e-8a3f-3c2948c7dc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3139c1c-0bed-4c3b-8932-1124b211e625', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4315ee-80bc-4f4b-96c6-b6442c424b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume volume-d3139c1c-0bed-4c3b-8932-1124b211e625 (d3139c1c-0bed-4c3b-8932-1124b211e625): created successfully
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a4315ee-80bc-4f4b-96c6-b6442c424b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (93206677-8d7e-4cea-929f-83cb59e8ada1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (9c646c5a-b97b-4994-96d9-562d2b77e3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c92987-c36b-45d5-b873-58c440a7f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-296a736a-8fd1-4de4-a16e-aa13d576f2b2 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created volume successfully.
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c92987-c36b-45d5-b873-58c440a7f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-481208659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e14725-d806-4808-824b-813a8f7764b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:35Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db24775e-1569-40d5-bc24-11cde32cf016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db24775e-1569-40d5-bc24-11cde32cf016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68664b13-8d37-4efa-8c84-6186a5460ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68664b13-8d37-4efa-8c84-6186a5460ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e14725-d806-4808-824b-813a8f7764b0', 'volume_name': 'volume-08e14725-d806-4808-824b-813a8f7764b0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fab604-4787-4df9-97fb-47635b2e469d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fab604-4787-4df9-97fb-47635b2e469d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5802e27b-acd4-4299-b5e5-bbbe63acfd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume 08e14725-d806-4808-824b-813a8f7764b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e14725-d806-4808-824b-813a8f7764b0', 'volume_size': 1}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-481208659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e14725-d806-4808-824b-813a8f7764b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:35Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Creating volume 08e14725-d806-4808-824b-813a8f7764b0 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:34 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08e14725-d806-4808-824b-813a8f7764b0 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:34 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=165, name=volume-08e14725-d806-4808-824b-813a8f7764b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:34 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (7f35039a-75b9-4548-aef4-be4280030988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:34 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7096e77e-bded-4be4-94a0-3c95ccc3de6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7096e77e-bded-4be4-94a0-3c95ccc3de6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839304552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c188f4f-78e4-4b59-88ce-5a39683c8c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:35Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e549b1a-9112-47aa-bb7e-bd0c598e95b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e549b1a-9112-47aa-bb7e-bd0c598e95b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3688148a-ae08-484c-81a5-ec5b6400ac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3688148a-ae08-484c-81a5-ec5b6400ac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c188f4f-78e4-4b59-88ce-5a39683c8c3b', 'volume_name': 'volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d5a74e-c065-4e7c-84ed-b60d499629e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d5a74e-c065-4e7c-84ed-b60d499629e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ae8256-40fe-4bf6-9650-3431de96d02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume 9c188f4f-78e4-4b59-88ce-5a39683c8c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b', 'volume_size': 1}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08e14725-d806-4808-824b-813a8f7764b0 1073741824" returned: 0 in 0.186s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08e14725-d806-4808-824b-813a8f7764b0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:35 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Flow 'volume_create_manager' (e141bb87-ac6e-41f9-91de-954f8c30a6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794c1e0e-0d1f-4e75-902f-17636bf043d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08e14725-d806-4808-824b-813a8f7764b0" returned: 0 in 0.046s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] <== create_volume: return (239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.241s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.059s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1839304552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c188f4f-78e4-4b59-88ce-5a39683c8c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f161d69de249ee93ad878a020bba48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:35Z,use_quota=True,user_id='e71bb2e2024f42088f1f46f57705632f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Creating volume 9c188f4f-78e4-4b59-88ce-5a39683c8c3b {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794c1e0e-0d1f-4e75-902f-17636bf043d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-128118649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9ea199-70bb-45f9-a46b-01e4158cef51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e14d9d22d2b48e9acd55ac63e49c54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:35Z,use_quota=True,user_id='86ac699bf014482988da0737998d63cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f4e65f-aaeb-4ac8-89d1-63e253398f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f4e65f-aaeb-4ac8-89d1-63e253398f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2aafc1-7bba-401c-a1eb-ba86e1cec279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2aafc1-7bba-401c-a1eb-ba86e1cec279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9ea199-70bb-45f9-a46b-01e4158cef51', 'volume_name': 'volume-df9ea199-70bb-45f9-a46b-01e4158cef51', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ddb8c9-d5b0-44c4-9f85-76c7dcace9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ddb8c9-d5b0-44c4-9f85-76c7dcace9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11154a35-4f22-4fb9-8806-2694285316e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Volume df9ea199-70bb-45f9-a46b-01e4158cef51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9ea199-70bb-45f9-a46b-01e4158cef51', 'volume_size': 1}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5802e27b-acd4-4299-b5e5-bbbe63acfd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e14725-d806-4808-824b-813a8f7764b0', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89feaf5a-62e3-46dd-8c9c-dda970a39263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=166, name=volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume volume-08e14725-d806-4808-824b-813a8f7764b0 (08e14725-d806-4808-824b-813a8f7764b0): created successfully
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89feaf5a-62e3-46dd-8c9c-dda970a39263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (9c646c5a-b97b-4994-96d9-562d2b77e3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d7842952-96e8-458f-af1b-82d21c6eeefe tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created volume successfully.
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b 1073741824" returned: 0 in 0.140s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] <== create_volume: return (169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.171s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-128118649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9ea199-70bb-45f9-a46b-01e4158cef51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e14d9d22d2b48e9acd55ac63e49c54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:35Z,use_quota=True,user_id='86ac699bf014482988da0737998d63cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Creating volume df9ea199-70bb-45f9-a46b-01e4158cef51 {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ae8256-40fe-4bf6-9650-3431de96d02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ece786-8e74-48eb-8250-f75e2ec69073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack quobyte-client[79699]: System call "open" of process 96784 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:35 devstack quobyte-client[79699]: System call "ioctl" of process 96784 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:35 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=167, name=volume-df9ea199-70bb-45f9-a46b-01e4158cef51, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b (9c188f4f-78e4-4b59-88ce-5a39683c8c3b): created successfully
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ece786-8e74-48eb-8250-f75e2ec69073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Flow 'volume_create_manager' (7f35039a-75b9-4548-aef4-be4280030988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ca612550-9c51-46e9-83ee-164220e71e52 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created volume successfully.
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 1073741824" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] <== create_volume: return (154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.157s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11154a35-4f22-4fb9-8806-2694285316e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9ea199-70bb-45f9-a46b-01e4158cef51', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81130040-3c42-43df-b90a-8a0dc88a84f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Volume volume-df9ea199-70bb-45f9-a46b-01e4158cef51 (df9ea199-70bb-45f9-a46b-01e4158cef51): created successfully
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81130040-3c42-43df-b90a-8a0dc88a84f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:35 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Flow 'volume_create_manager' (e141bb87-ac6e-41f9-91de-954f8c30a6d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:35 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-675b3856-f7e8-4858-abf0-80c796123c4e tempest-CinderUnicodeTest-1832705403 None] Created volume successfully.
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-9c188f4f-78e4-4b59-88ce-5a39683c8c3b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-9c188f4f-78e4-4b59-88ce-5a39683c8c3b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:36 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-quobyte-9c188f4f-78e4-4b59-88ce-5a39683c8c3b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-9c188f4f-78e4-4b59-88ce-5a39683c8c3b" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0df2c98-570b-4072-803c-1063613fdeeb]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b" returned: 0 in 0.154s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Creating offline snapshot ce57ad99-ef7b-4255-bde7-fa349d1be743 of volume df9ea199-70bb-45f9-a46b-01e4158cef51 {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-9c188f4f-78e4-4b59-88ce-5a39683c8c3b" returned: 0 in 0.040s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc29a945-89cb-4e4d-8b39-0c026bb0a6c8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-9c188f4f-78e4-4b59-88ce-5a39683c8c3b" released by "delete_volume" :: held 0.233s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created reservations ['db5d2b06-09fc-4545-b2a7-76ce1dec4b22', '4de6bc7b-c056-48fe-b2bd-a633250e8941', '5e471aec-ab3e-41d8-8cc1-98ed5f9450ae', '1fef16c9-b374-4d91-b2b2-efc6b340045b'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:36 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Deleted volume successfully.
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1b67978f-16cc-49cb-90a7-9bbda9c4c152 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-9c188f4f-78e4-4b59-88ce-5a39683c8c3b-delete_volume" released by "delete_volume" :: held 0.407s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51" returned: 0 in 0.154s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=168, name=volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 1G" returned: 0 in 0.111s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): qemu-img rebase -u -b volume-df9ea199-70bb-45f9-a46b-01e4158cef51 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] CMD "qemu-img rebase -u -b volume-df9ea199-70bb-45f9-a46b-01e4158cef51 -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743" returned: 0 in 0.044s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.info" returned: 0 in 0.044s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.info" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:36 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.455s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:36 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-f664591e-0c1e-42c5-8829-ed04f942fc69 tempest-CinderUnicodeTest-1832705403 None] Create snapshot completed successfully
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-08e14725-d806-4808-824b-813a8f7764b0-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-08e14725-d806-4808-824b-813a8f7764b0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:37 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-quobyte-08e14725-d806-4808-824b-813a8f7764b0" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-08e14725-d806-4808-824b-813a8f7764b0" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1ab83-ef6d-4426-a5de-96db8b324bde]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08e14725-d806-4808-824b-813a8f7764b0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "cinder-ce57ad99-ef7b-4255-bde7-fa349d1be743-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-ce57ad99-ef7b-4255-bde7-fa349d1be743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:37 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "cinder-quobyte-df9ea199-70bb-45f9-a46b-01e4158cef51" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-quobyte-df9ea199-70bb-45f9-a46b-01e4158cef51" acquired by "delete_snapshot" :: waited 0.024s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "cinder-quobyte-ce57ad99-ef7b-4255-bde7-fa349d1be743" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08e14725-d806-4808-824b-813a8f7764b0" returned: 0 in 0.190s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08e14725-d806-4808-824b-813a8f7764b0 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-quobyte-ce57ad99-ef7b-4255-bde7-fa349d1be743" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Deleting offline snapshot ce57ad99-ef7b-4255-bde7-fa349d1be743 of volume df9ea199-70bb-45f9-a46b-01e4158cef51 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] snapshot_file for this snap is: volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-08e14725-d806-4808-824b-813a8f7764b0" returned: 0 in 0.031s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-08e14725-d806-4808-824b-813a8f7764b0" released by "delete_volume" :: held 0.245s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b914f1-d7d5-4a45-aa95-f5da9d5c4856]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created reservations ['671b8aa3-3247-4587-8d1d-9331a8875fb9', '47c78783-ac16-4455-8471-e678f840c8ee', 'da96d073-fe8b-4a3b-af57-b05a53bff0a4', '2ffd03c5-49a1-4d00-b222-e81ea327b158'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:37 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Flow 'volume_create_manager' (0da34954-5a00-43ab-96fd-ef66801c180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c509ac72-96f7-4e47-bb8e-3858d19e1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c509ac72-96f7-4e47-bb8e-3858d19e1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-280471858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08edbe7-3747-45ad-85bd-5020040510cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa73a1c3eeb1418fb662a371f52495a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:37Z,use_quota=True,user_id='22109c76e06745428bd6d1b26fc82d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfae41bd-86f2-4aae-a889-6848984cbe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfae41bd-86f2-4aae-a889-6848984cbe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e62d9f-8bfa-4819-82f7-71034c60b6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e62d9f-8bfa-4819-82f7-71034c60b6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08edbe7-3747-45ad-85bd-5020040510cc', 'volume_name': 'volume-d08edbe7-3747-45ad-85bd-5020040510cc', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259ed21b-aa96-497a-9fe8-6e938db578f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259ed21b-aa96-497a-9fe8-6e938db578f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe333526-9c93-4206-990a-bbdade30d21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:37 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Volume d08edbe7-3747-45ad-85bd-5020040510cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08edbe7-3747-45ad-85bd-5020040510cc', 'volume_size': 1}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f673e703f70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-280471858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08edbe7-3747-45ad-85bd-5020040510cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa73a1c3eeb1418fb662a371f52495a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:37Z,use_quota=True,user_id='22109c76e06745428bd6d1b26fc82d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)}" {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Creating volume d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:37 devstack cinder-volume[79893]: INFO cinder.volume.drivers.remotefs [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] casted to osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc 1073741824 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743" returned: 0 in 0.182s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df9ea199-70bb-45f9-a46b-01e4158cef51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bd68ff-f1c5-4111-b3a4-ab78e0843e07]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=170, name=volume-d08edbe7-3747-45ad-85bd-5020040510cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:37 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Deleted volume successfully.
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-6c768348-c1c5-4d32-a0a1-dcc4f931412a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-08e14725-d806-4808-824b-813a8f7764b0-delete_volume" released by "delete_volume" :: held 0.549s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc 1073741824" returned: 0 in 0.109s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] <== create_volume: return (131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'} {{(pid=79893) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.134s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe333526-9c93-4206-990a-bbdade30d21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08edbe7-3747-45ad-85bd-5020040510cc', 'volume_size': 1}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b89181-9d7f-4dd0-b6c4-a9f3904059c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:37 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Volume volume-d08edbe7-3747-45ad-85bd-5020040510cc (d08edbe7-3747-45ad-85bd-5020040510cc): created successfully
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b89181-9d7f-4dd0-b6c4-a9f3904059c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Flow 'volume_create_manager' (0da34954-5a00-43ab-96fd-ef66801c180b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:37 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-91bc29db-f6ea-4d46-80f8-038b4ce9c917 tempest-SnapshotDependencyTests-1563463582 None] Created volume successfully.
Sep 30 20:36:37 devstack quobyte-client[79699]: System call "getattr" of process 96818 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51" returned: 0 in 0.153s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack quobyte-client[79699]: System call "getattr" of process 96823 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:37 devstack quobyte-client[79699]: System call "open" of process 96823 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743" returned: 0 in 0.062s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51.ce57ad99-ef7b-4255-bde7-fa349d1be743" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-quobyte-ce57ad99-ef7b-4255-bde7-fa349d1be743" released by "_delete_snapshot" :: held 0.480s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-quobyte-df9ea199-70bb-45f9-a46b-01e4158cef51" released by "delete_snapshot" :: held 0.510s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Created reservations ['d114dcfd-9323-4222-ba66-6f427724f0bb', 'b500fc0e-e760-4880-a3a6-b6cf7bed5c32', '4184fd2e-14a6-4f7e-a13c-a5b1843d2649', '7f5712f0-6761-40eb-94e7-2312a20de5c6'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:37 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Delete snapshot completed successfully.
Sep 30 20:36:37 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-43160e6f-65b2-4086-b073-391919a71147 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-ce57ad99-ef7b-4255-bde7-fa349d1be743-delete_snapshot" released by "delete_snapshot" :: held 0.604s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-d3139c1c-0bed-4c3b-8932-1124b211e625-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-d3139c1c-0bed-4c3b-8932-1124b211e625-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:38 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-quobyte-d3139c1c-0bed-4c3b-8932-1124b211e625" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-d3139c1c-0bed-4c3b-8932-1124b211e625" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a12bbbb-ecc2-4d51-abdb-d88e5b3c56f1]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d3139c1c-0bed-4c3b-8932-1124b211e625 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d3139c1c-0bed-4c3b-8932-1124b211e625" returned: 0 in 0.137s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d3139c1c-0bed-4c3b-8932-1124b211e625 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d3139c1c-0bed-4c3b-8932-1124b211e625" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "cinder-df9ea199-70bb-45f9-a46b-01e4158cef51-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-d3139c1c-0bed-4c3b-8932-1124b211e625" released by "delete_volume" :: held 0.195s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-df9ea199-70bb-45f9-a46b-01e4158cef51-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:38 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "cinder-quobyte-df9ea199-70bb-45f9-a46b-01e4158cef51" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created reservations ['0fe3257a-7bbf-4c00-b80b-133af3d3935f', 'e0b97bf1-d840-4e2b-b75a-d013f88ea99f', '5a2907d8-d303-4df8-aa78-02b602c32c64', '7351722b-b1d8-4dac-b037-cc63423ca180'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-quobyte-df9ea199-70bb-45f9-a46b-01e4158cef51" acquired by "delete_volume" :: waited 0.027s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb2939-5ab7-4515-b7db-cf5b1f3cfa7c]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.030s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:38 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Deleted volume successfully.
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-9c76fe7c-f727-4b6c-a886-d3186367764d tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-d3139c1c-0bed-4c3b-8932-1124b211e625-delete_volume" released by "delete_volume" :: held 0.420s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51" returned: 0 in 0.169s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-df9ea199-70bb-45f9-a46b-01e4158cef51" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-quobyte-df9ea199-70bb-45f9-a46b-01e4158cef51" released by "delete_volume" :: held 0.233s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:38 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Creating offline snapshot 4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f of volume d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745b6fe-879c-454e-891a-5df0936e6c95]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Created reservations ['2747b818-2263-41ff-bb05-0c36bc6eb0d9', '6dde488d-a787-4d4e-a4e0-95d48718b059', '2167c890-466f-416e-8574-f25e636f68cc', '93ac469a-42e9-4308-9ec4-6b2d389ed02e'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:38 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Deleted volume successfully.
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-ffe0cb5b-d961-45bd-99cc-e1011ecff7df tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-df9ea199-70bb-45f9-a46b-01e4158cef51-delete_volume" released by "delete_volume" :: held 0.427s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc" returned: 0 in 0.127s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:38 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f 1G {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:38 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=171, name=volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f 1G" returned: 0 in 0.088s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d08edbe7-3747-45ad-85bd-5020040510cc -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] CMD "qemu-img rebase -u -b volume-d08edbe7-3747-45ad-85bd-5020040510cc -F qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" returned: 0 in 0.035s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Setting permissions: /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc -> 1000:1000 {{(pid=79893) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.info" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.info is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.info {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.info" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 0.366s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:39 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-3f2b9723-6051-46d9-98d3-22792e79e63b tempest-SnapshotDependencyTests-1563463582 None] Create snapshot completed successfully
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-2a33bc15-6442-4c3e-9171-34f8fe1be78b-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-2a33bc15-6442-4c3e-9171-34f8fe1be78b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:39 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-quobyte-2a33bc15-6442-4c3e-9171-34f8fe1be78b" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-2a33bc15-6442-4c3e-9171-34f8fe1be78b" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[69da6222-9dfd-4a21-8b37-cabf5491d295]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b" returned: 0 in 0.131s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2a33bc15-6442-4c3e-9171-34f8fe1be78b" returned: 0 in 0.025s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-2a33bc15-6442-4c3e-9171-34f8fe1be78b" released by "delete_volume" :: held 0.179s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "cinder-2c6e86d8-093d-439a-9c42-272208c4ff21-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created reservations ['8a97f8e5-a0b6-4cc7-bdd7-1d196636e9a7', 'cb6b84bd-22eb-4919-8338-eabab60caf16', 'a36ed9dd-a648-457a-bd54-797b2366dc83', '9220fe25-7fa7-4ba9-9e63-55d06987f4b1'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-2c6e86d8-093d-439a-9c42-272208c4ff21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:39 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "cinder-quobyte-2c6e86d8-093d-439a-9c42-272208c4ff21" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-quobyte-2c6e86d8-093d-439a-9c42-272208c4ff21" acquired by "delete_volume" :: waited 0.024s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[486fb371-3ced-4637-9812-cfdf786f80e3]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2c6e86d8-093d-439a-9c42-272208c4ff21 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Deleted volume successfully.
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-40301f51-fbcb-459f-a3e9-cc6edf2d5d72 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-2a33bc15-6442-4c3e-9171-34f8fe1be78b-delete_volume" released by "delete_volume" :: held 0.367s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2c6e86d8-093d-439a-9c42-272208c4ff21" returned: 0 in 0.137s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2c6e86d8-093d-439a-9c42-272208c4ff21 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-2c6e86d8-093d-439a-9c42-272208c4ff21" returned: 0 in 0.024s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-quobyte-2c6e86d8-093d-439a-9c42-272208c4ff21" released by "delete_volume" :: held 0.181s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Created reservations ['83035dc6-43cd-4120-88dc-360e998cdf3e', '7635600e-d9cf-4df0-98d2-d3855d2ffb22', '6e0d2b2d-f598-47e1-8d6f-e3dfc7d1c07f', 'c74f0532-625b-41e0-9b98-55cf3224925a'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.020s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:39 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Deleted volume successfully.
Sep 30 20:36:39 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-4c3f9e72-6de6-4205-ae44-edf6e6602df6 tempest-CinderUnicodeTest-1832705403 None] Lock "cinder-2c6e86d8-093d-439a-9c42-272208c4ff21-delete_volume" released by "delete_volume" :: held 0.365s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.flows.manager.create_volume [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=79893) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1384}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Flow 'volume_create_manager' (8686fd7d-5f25-4c55-a0f8-868815200d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3128ed-1648-49a0-92b1-47111495a872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3128ed-1648-49a0-92b1-47111495a872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-30T18:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db19090-1eca-4813-8e70-91312c30ca34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa73a1c3eeb1418fb662a371f52495a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-30T18:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-30T18:36:40Z,use_quota=True,user_id='22109c76e06745428bd6d1b26fc82d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c69525e-af70-4bd1-a221-762ac91a51a5),volume_type_id=3c69525e-af70-4bd1-a221-762ac91a51a5)' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5373a60-fd14-438a-ac87-927e559b9e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5373a60-fd14-438a-ac87-927e559b9e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06411937-97ae-42e5-a3f1-aa3bc7b9d5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06411937-97ae-42e5-a3f1-aa3bc7b9d5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1db19090-1eca-4813-8e70-91312c30ca34', 'volume_name': 'volume-1db19090-1eca-4813-8e70-91312c30ca34', 'volume_size': 1, 'snapshot_id': '4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f'}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b4f314-e18f-40b8-8b72-d6edab18db6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b4f314-e18f-40b8-8b72-d6edab18db6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141fd6ef-5204-4915-a556-a234ed6e618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:40 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Volume 1db19090-1eca-4813-8e70-91312c30ca34: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1db19090-1eca-4813-8e70-91312c30ca34', 'volume_size': 1, 'snapshot_id': '4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f'}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-quobyte-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f-1db19090-1eca-4813-8e70-91312c30ca34" by "_create_volume_from_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f-1db19090-1eca-4813-8e70-91312c30ca34" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Creating volume 1db19090-1eca-4813-8e70-91312c30ca34 from snapshot 4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Selected osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e as target Quobyte volume. {{(pid=79893) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-quobyte-1db19090-1eca-4813-8e70-91312c30ca34" by "_copy_volume_from_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-1db19090-1eca-4813-8e70-91312c30ca34" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] snapshot: 4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f, volume: 1db19090-1eca-4813-8e70-91312c30ca34,  {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f650afc-fdb9-44bf-9ea2-348f47867949]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" returned: 0 in 0.118s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08edbe7-3747-45ad-85bd-5020040510cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Creating direct copy from snapshot {{(pid=79893) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b59c5e3-91ef-4b65-a7c1-0ab5c3bb19f0]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-233548d1-3840-496d-9dc6-d251dc43932d-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-233548d1-3840-496d-9dc6-d251dc43932d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:40 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-quobyte-233548d1-3840-496d-9dc6-d251dc43932d" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-233548d1-3840-496d-9dc6-d251dc43932d" acquired by "delete_volume" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d3f769-40c3-4a97-9ac7-2d9d9d38fad4]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-233548d1-3840-496d-9dc6-d251dc43932d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc" returned: 0 in 0.166s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.utils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34 not found in is_blk_device check {{(pid=79893) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:40 devstack quobyte-client[79699]: The server volume:584744b4-c010-424f-99b5-4037d32ed6f3@10.10.41.20:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=584744b4-c010-424f-99b5-4037d32ed6f3, inode=173, name=volume-1db19090-1eca-4813-8e70-91312c30ca34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=699dc21a-7a80-465d-9479-fc84f0dc4558,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.53), requestorAccessMask=0
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-233548d1-3840-496d-9dc6-d251dc43932d" returned: 0 in 0.172s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-233548d1-3840-496d-9dc6-d251dc43932d {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-233548d1-3840-496d-9dc6-d251dc43932d" returned: 0 in 0.022s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-233548d1-3840-496d-9dc6-d251dc43932d" released by "delete_volume" :: held 0.227s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:40 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created reservations ['5619bcd2-6d91-43d2-a558-5df334b94e7b', '8920addd-c201-4503-bf77-15df99c615cd', '46328d35-9ea6-418d-8a94-cfda04527b86', '14702f41-4899-4ffd-a44c-20a45f5ce389'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.111s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:41 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Deleted volume successfully.
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-d0893290-0949-4f13-922b-175dc6342e27 tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-233548d1-3840-496d-9dc6-d251dc43932d-delete_volume" released by "delete_volume" :: held 0.799s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:41 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-6fc4c253-730c-4ae8-a440-1418412a9e52-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-6fc4c253-730c-4ae8-a440-1418412a9e52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:41 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-quobyte-4fbf3f61-c736-4931-b388-fa989dbe3468" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-4fbf3f61-c736-4931-b388-fa989dbe3468" acquired by "delete_snapshot" :: waited 0.016s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-quobyte-6fc4c253-730c-4ae8-a440-1418412a9e52" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-6fc4c253-730c-4ae8-a440-1418412a9e52" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Deleting offline snapshot 6fc4c253-730c-4ae8-a440-1418412a9e52 of volume 4fbf3f61-c736-4931-b388-fa989dbe3468 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] snapshot_file for this snap is: volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[958da030-023b-4ac2-83e3-b440b4d6346e]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:41 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:42 devstack quobyte-client[79699]: System call "open" of process 96883 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52" returned: 0 in 0.215s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fbf3f61-c736-4931-b388-fa989dbe3468(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e391cb30-ee9e-49e1-beab-370efe6053dc]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34" returned: 0 in 1.713s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[a578bea4-fbda-46d0-b139-1a24c8d22965]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468" returned: 0 in 0.210s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:42 devstack quobyte-client[79699]: System call "getattr" of process 96891 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52" returned: 0 in 0.080s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468.6fc4c253-730c-4ae8-a440-1418412a9e52" returned: 0 in 0.032s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-6fc4c253-730c-4ae8-a440-1418412a9e52" released by "_delete_snapshot" :: held 0.626s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-4fbf3f61-c736-4931-b388-fa989dbe3468" released by "delete_snapshot" :: held 0.664s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created reservations ['1b8a76eb-1e7f-41a9-8e7f-36327c1ba21f', 'f36bbbd7-e811-4105-83c3-ed87286f029f', '09e74cdf-aeb5-48b2-a666-88b6cae87a75', '6bd7f0a9-7f24-4a80-994d-7ab31d622ccd'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Delete snapshot completed successfully.
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-41e96284-d96f-40d6-99eb-90ea1eefb57b tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-6fc4c253-730c-4ae8-a440-1418412a9e52-delete_snapshot" released by "delete_snapshot" :: held 0.753s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc" returned: 0 in 0.313s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.image.image_utils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Image conversion details: src /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc, size 1024.00 MB, duration 1.71 sec, destination /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34 {{(pid=79893) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 30 20:36:42 devstack cinder-volume[79893]: INFO cinder.image.image_utils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Converted 1024.00 MB image at 597.26 MB/s
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] File path /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34 is being set with permissions: 660 {{(pid=79893) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-1db19090-1eca-4813-8e70-91312c30ca34" released by "_copy_volume_from_snapshot" :: held 2.389s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f-1db19090-1eca-4813-8e70-91312c30ca34" released by "_create_volume_from_snapshot" :: held 2.402s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.409s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (141fd6ef-5204-4915-a556-a234ed6e618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db19090-1eca-4813-8e70-91312c30ca34', 'volume_size': 1, 'snapshot_id': '4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f'}' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7164be8-11d4-4fb7-83db-d5cba302828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 30 20:36:42 devstack cinder-volume[79893]: INFO cinder.volume.flows.manager.create_volume [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Volume volume-1db19090-1eca-4813-8e70-91312c30ca34 (1db19090-1eca-4813-8e70-91312c30ca34): created successfully
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7164be8-11d4-4fb7-83db-d5cba302828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=79893) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Flow 'volume_create_manager' (8686fd7d-5f25-4c55-a0f8-868815200d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=79893) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 30 20:36:42 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-df01b22f-1402-4b82-90b4-6c0f4ebf368d tempest-SnapshotDependencyTests-1563463582 None] Created volume successfully.
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-4fbf3f61-c736-4931-b388-fa989dbe3468-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-4fbf3f61-c736-4931-b388-fa989dbe3468-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:42 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "cinder-quobyte-4fbf3f61-c736-4931-b388-fa989dbe3468" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-4fbf3f61-c736-4931-b388-fa989dbe3468" acquired by "delete_volume" :: waited 0.005s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ea9345-25ad-48a5-a4dd-70494d757572]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:42 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468" returned: 0 in 0.128s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-4fbf3f61-c736-4931-b388-fa989dbe3468" returned: 0 in 0.023s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-quobyte-4fbf3f61-c736-4931-b388-fa989dbe3468" released by "delete_volume" :: held 0.176s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Created reservations ['2ee21887-dff9-4238-a2d7-f726b3b927f8', '3160f400-f1bf-4971-b774-cf92d40ada16', 'dfab3616-52f2-47c5-9e9b-dd7d85cd4c33', '678c6238-1bcb-4421-aeec-ab7bf3ab446f'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Deleted volume successfully.
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-02769fc5-9655-4299-b769-acb18faeb49a tempest-CreateVolumesFromSnapshotTest-1235214650 None] Lock "cinder-4fbf3f61-c736-4931-b388-fa989dbe3468-delete_volume" released by "delete_volume" :: held 0.304s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f-delete_snapshot" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:43 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-quobyte-d08edbe7-3747-45ad-85bd-5020040510cc" by "delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-d08edbe7-3747-45ad-85bd-5020040510cc" acquired by "delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-quobyte-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" by "_delete_snapshot" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Deleting offline snapshot 4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f of volume d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] snapshot_file for this snap is: volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab1118b-21a7-4a6a-b334-a5ae4adb67b8]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" returned: 0 in 0.123s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.remotefs [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d08edbe7-3747-45ad-85bd-5020040510cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=79893) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b51f391-f488-4b87-803c-13fb4bae0c90]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc" returned: 0 in 0.126s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" returned: 0 in 0.060s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc.4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f" released by "_delete_snapshot" :: held 0.384s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-d08edbe7-3747-45ad-85bd-5020040510cc" released by "delete_snapshot" :: held 0.395s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Created reservations ['fc7171da-7a79-45c1-b5bf-e170fb856d16', 'd63c57f2-0735-4a58-89a1-014c260fe3b0', 'eba5a791-00ee-43a2-9bb0-418b0725ad24', 'cfdfb274-6f72-4009-a06e-dc709349fbc0'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:43 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Delete snapshot completed successfully.
Sep 30 20:36:43 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-1964dd38-a4b3-4d65-82b5-bda02be1da0f tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-4a9e2b5b-c679-4f5e-afac-bdb9ce9f917f-delete_snapshot" released by "delete_snapshot" :: held 0.483s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-d08edbe7-3747-45ad-85bd-5020040510cc-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-d08edbe7-3747-45ad-85bd-5020040510cc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:44 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-quobyte-d08edbe7-3747-45ad-85bd-5020040510cc" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-d08edbe7-3747-45ad-85bd-5020040510cc" acquired by "delete_volume" :: waited 0.009s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378550b-a337-462b-a500-3483f09e7c5b]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:44 devstack quobyte-client[79699]: System call "getattr" of process 96913 (qemu-img) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc" returned: 0 in 0.153s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-d08edbe7-3747-45ad-85bd-5020040510cc" returned: 0 in 0.018s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-d08edbe7-3747-45ad-85bd-5020040510cc" released by "delete_volume" :: held 0.210s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Created reservations ['59de4d74-afc4-4aea-b8e4-de9ecfd574e1', '5552fe53-198c-4ad6-b863-3ae4991ee02c', '18fd3090-6dc0-4df1-b2e6-20100672eb32', 'd384c617-f814-4389-9569-4b39d06deed7'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:44 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Deleted volume successfully.
Sep 30 20:36:44 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-32be6684-1db2-4fda-aef2-569466caa5dc tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-d08edbe7-3747-45ad-85bd-5020040510cc-delete_volume" released by "delete_volume" :: held 0.401s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-1db19090-1eca-4813-8e70-91312c30ca34-delete_volume" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-1db19090-1eca-4813-8e70-91312c30ca34-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:45 devstack cinder-volume[79893]: WARNING cinder.volume.volume_utils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "cinder-quobyte-1db19090-1eca-4813-8e70-91312c30ca34" by "delete_volume" {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-1db19090-1eca-4813-8e70-91312c30ca34" acquired by "delete_volume" :: waited 0.007s {{(pid=79893) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo.privsep.daemon [-] privsep: reply[553bfcf2-9e13-4f0d-a219-0f2a802b6fb9]: (4, 'qcow2') {{(pid=80463) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34" returned: 0 in 0.121s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] CMD "rm -f /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022/volume-1db19090-1eca-4813-8e70-91312c30ca34" returned: 0 in 0.017s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-quobyte-1db19090-1eca-4813-8e70-91312c30ca34" released by "delete_volume" :: held 0.162s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.quota [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Created reservations ['0751fdaf-720c-4e69-bfe5-7147ea4263b7', '8cb6845d-10ba-4903-9544-b93c74c8e598', '5e7e52ce-21dd-404e-817c-cf474d182e48', '19fb0d40-c150-4229-9bd1-458f1c3aed89'] {{(pid=79893) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.016s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:45 devstack cinder-volume[79893]: INFO cinder.volume.manager [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Deleted volume successfully.
Sep 30 20:36:45 devstack cinder-volume[79893]: DEBUG cinder.coordination [None req-89fdddce-3cda-4647-930c-fc3a45f5e896 tempest-SnapshotDependencyTests-1563463582 None] Lock "cinder-1db19090-1eca-4813-8e70-91312c30ca34-delete_volume" released by "delete_volume" :: held 0.292s {{(pid=79893) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 30 20:36:49 devstack quobyte-client[79699]: Unable to open /proc/80464/environ
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG oslo_service.periodic_task [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=79893) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e': None} {{(pid=79893) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG cinder.volume.drivers.quobyte [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f32e05f0-3525-4425-9294-1478f9376c4e'] {{(pid=79893) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.lockutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=79893) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022 {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG oslo_concurrency.processutils [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/2f315302648ad8094e9d5ad1e6405022" returned: 0 in 0.019s {{(pid=79893) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 30 20:36:51 devstack cinder-volume[79893]: DEBUG cinder.manager [None req-5387f0f0-616e-4d3c-90d7-21c6a40c16a1 None None] Notifying Schedulers of capabilities ... {{(pid=79893) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 30 20:36:55 devstack cinder-volume[79893]: DEBUG dbcounter [-] [79893] Writing DB stats cinder:SELECT=161,cinder:UPDATE=246,cinder:DELETE=22,cinder:INSERT=52 {{(pid=79893) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 30 20:36:56 devstack quobyte-client[79699]: Unable to open /proc/80464/environ